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INTRODUCTION 
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The value of exchanging information and ideas among science 
curriculum development projects has long been recognized by 
curriculum developers. In previous meetings of developers of 
science curricula supported by grants from the National Science 
Foundation, the main concern has been the progress of each pro- 
ject, and how each project achieved successes and solved 
difficulties. 

The unique feature of the meeting of curriculum developers in 
Septembec 1974 — the subject of this report— was» tHe concern for 
the broad picture of pre-college stiience education, rather than 
with the details of individual projects. Discussions at Jhe meeting, 
which was held at Airlie House, Warrenton, Virginia on 13-15 
September 1974, focused on Ihree areas: developing interdiscipli- 
nary sciencs curricula; formative and summative evaluation; and 
dissemination and ifnplementatiom • • 

Consideration of each of these areas was begun with a formal 
paper presented by a curriculum developer. Each paper was fol- 
lowed by a critical reaction by another participant, and this in turn 
was followed by an hour of discussion by the participants meeting 
in six small groups. A summary of the discussions was presented 
in a following plenary session. 

During the last afternoon of the meeting, the project directors 
assembled' again in small groups to exchange ideas and to make 
recommendation^ on future directions for pre-college science 
education. Summaries of the deliberations of the groups were 
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presented in a final plenary session by a panel consisting of a rep- 
resentative from each group. 

This report includes condensations of the papers on inter- 
disciplinary curricula, evaluation and dissemination, 'and of the 
reactions to the papers. The full papers and- the reattions are in 
the Appendix. The report also includes* the highlights of the dis- 
gu^sion sessions at which the small groups reported. The final 
sei^tion of the report summarizes the reqommendations on future 
direc|j[ons for pre-college science education that were made by 
the small discussion groups and presented by the panel in the final 
session of the meeting. 

' ' The meeting was arranged by the staff of the Materials and In- 
struction Development Section of the Division of Pre-College Edu- 
cation in Science of the National Science Foundation under the 
direction of Dr. Laurence O. Binder. Dr. Jean B. Intermaggio, Pro- 
gram Mai>'ager of. MIDS/PEDS, assumed major responsibility for 
organizing the meeting. The Office of Science Education of the 
American Association for the Advancement of Science assisted 
with the arrangements for the meeting and prepared this report. 

* ^ Arthur H. Livermore 

« ; Office of Science Education 

1 .1 AAAS 
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INTEGRATED 
CURRICULA 



Condensation of Science, Schooling and Society: The 
Search for an Integrated Curriculum. Peter B. Dow.* ^ 



The fragmentation of l?:nowl.edge, **the fatal disconnection 
, which kills the vitality of modern curriculum" (Whitehead, 1912), 
continues today. We are adding endlessly the list of available 
^ subjects wh^le neglecting to ask what organizing "ideas and prin- 
. ciples give meaning to the academic quest. * 

From the beginning, Americans have equated educatioa with 
the preservation and^improvement of society. Through cultivation 
o.f tntellect, virtue, and a love of liberty, citizens will perpetuate 
the free society. (Thomas Jefferson.) Academic achieverhent 
sho4ild be subordinated to the promotion of human values. 
(Horace Mann.J 

Who speaks for the aims of education today? Our voices are 
easily drowned out by the demand for accountability and effi- 
ciency, the quantitative values of a technological age. John 
Dewey in his Pedagogic Creed (1897) reiterated his underlying 
assumption of American education: Jhe training of the mind and 
the shaping of character cannot be divorced from a consideration 
of the values of the society of which the educational system is a 
^ fundamental pai^t^ 

*Full paper — page 31. ^ , 



In the years . following. Sputnik, science-based curriculum de- 
velopers paid little heed to the social purposes of instruction, 
Piaget and Bruner stressed child 'development and cogniti^ 
growth. No one talked much about the child as a social creature. 
Curriculum developments contributed to curriculum fragmenta- 
tion. . , * 

Now we are in the midst of a second wave of curriculum reform 
that is attempting to clos§ the gap between curriculum dfevelop^ 
ment and social need through an approach to curriculum making 
that relates the teachilig of '^disciplines" to the needs of society, 
' An example of the new approaich is the higli school course Ex- 
ploring Human Nature. The course draws onJ)iology, anthropology, 
psychology, and sociology to help students understand what it 
means to be a human bein^g in a'society that has distinctive norms 
and values, and as a member of a species having some general- 
izable. traits that are a product of a long evolutionary history. 

The most interesting issues in the study of human behavior fall 
between the disciplines. For example, to begin (a understand a 
simple behavior such as a two-year-old speaking requires input 
from the fields of physiology, biofogy, child-development, social 
psychology, anthropology and linguistics.^ ^ " 

In Exploring Human Nature the ma^terials are organized anound 
issues falling between disciplines and that appear to be interesthig 
to students— child-rearing practices, male-female differences, 
love ai^ affection, expressions of fear andJ^nger, parent-off- 
spring conflict, and so on. * 

tAmong the problems encountered by the scholars, teachers and 
curriculum writers as they developed Exploring Human Nature 
were: 

1) Differences in the terms used in different disciplines to name 
the same phenomenon — for/ example "bonding" (biology) and 
"love" or "attachment" (psychologjdtep describe - relationships 
between male aqd female or parent andoffspring. 

2) Disciplines draw on bodies of data* that do not overhp; for 
example, anthropologists are safe while they examine preliterate 
cultures, but are suspect when they wcfrk on recorded history, and 
psychologists may examine interpersonal behavior but do not 
extrapolate their findings to a theory of sociq.ty'. 

slTTlje cleavages between the natural and social sciences con- 
stitute, in extreme cases, fundamentally different points of view 
regarding the nature of man. Some isocial scientists go so far as to 
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assert that cultural evolution proceeds quite independent of 
biological factors (White), while some biol<>gists proclaim the 
primacy of biological fgrceg in understanding human behavior ' 
(Ardrey). 

Neither extreme view is satisfactory, for it is in the interaction 
df biolog/ and culture that some of the most interesting insights 
into huipan behavior emerge. Extraf^dtating irom experim^mts 
with rats, it is reasonable to postulate that human-beings are pre- 
disposed by tha evolutionary past to respond differently to en- 
vironmental forces. . ^ ^ 

Another example of the power of combining insights from biol- 
ogy and social science is in the study of pJair bonding and the evolu- 
" tion of the human family. .Social science alone cannot explain the 
• persistence of the family as a fundamental unit of society. Biology 
asks, "Why should ^atura| selection favor pair bonding between 
human male^ and females?" In this 'way biology iriformsthe social 
sciences. By combining the iilsights of • biology^ with those of 
anthropology we are able to provide students with a more com- 
prehensive way of thinking about human nature thap -^ny single 
discipline allows us. - « 

One of the most fruilfoT fields for interdisciplinary curriculum 
work is*, in environmental studies. Hep the natural and social 
sciences caq interact to^ explain the workings of the ecdsphere 
and to frame the crucial issues of our relationship ta the environ- 
ment. * 

It will take courage and energy to bring about reforms in educa- 
tion. Scholars and teachers alike are trapped in a -conventional 
pattern of curriculum organization. The gatekeepers at the schools 
are skeptical that they cannot identify what disciplines children 
are studying when they are following an interdisciplin'Sry'approach 
to real world problem^. * . . V 

But we must taJ^e heart and remember that it is our own^ hu- 
manity and that of our students that we seek to' rescue from those 
who would wrest it from us. "The frustration i. . . in which w^ are 
mired today will not leave us oantil we belieVe in ourselves again, 
assume ag^irf the mastery of our lives, the management of our 
means/' (MacLeish.) 
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REACTION 

Condensation of Integrative Curricula— a response t5 
' Peter Dow's paper. • Jafees T. Robinson.* " 



^. Resides the questions and issues discussed in Peter. Dow*s 
paper, there are additional problems that need to be considered. 
. *^Studetit disaffection is an issue that needs more elaboration. 
^ What students, at What age leVels are disaffected by what cur- 
^ ricjila, under what conditions, an^i for what reasons? We need 
r, much more .precise information on this problem to help determine 
€urriculu|n policy. We also need to decide *if we care about stli- 
dents* reaction tp curricula. The ideologies of curriculum devel- 
opers usually' have more to do with proposals for solving the 
problem than do^s information about the problem. I would urge 
that any single solution, incluiiing integrated curricula, be re- 
viewed very carefully before it isi applied to all curricula, for all 
students? at all levels — kindergarten through gradu'ate school. 

I would lilce to reformulate the student disaffection question to 
ask, "How does one design a curriculum so it will have personal 
meaniwg for each student?" This ^ question may need tb be 
answered in different ways for different students in different 
curriculum areas. Dow suggests that integrated curricula can con- 
tribute to solving this problem. 

The issue 1 am raising is that I think interdisciplinary structures 
are necessary, bt?t are not in themselves^ sufficient elements to 
contribute lo\ the resolution of the problems Dow raised. We also- 
need .to give serious consideration to how the curriculum should 
be organized, what are to be its essential means, and what arents 
desired /ends. And, I believe .th^t the question may require dif- 
ferent answers for students' af^different levels within the educa- 
tional system. 

I suggest that we not consider our job done with the invention 
of new integrative concepts. We need to invent alternatives to an 
academic organization for integrative curricula, alternatives that 
may vary considerably from kindergarten to^l^duate school. 

Redefining the broad areas of knowledge and transmitting them 
to students is irr/plicit in Dow's presentation. Kohlberg and Mayer 
(1S72) have recently argued that human development, as distinct 

*Full paper — page 43. ' / 
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from cultural transmission, should be the proper aim of education J 
Piaget's (1973) position is that logical thinking is created through ' 
organism-environment interaction, a process that seems to n^e to ' 
'be quite different from a student appropriating someone else's 
explanations. To me. this suggests that the importance ofMhe 
child*s constructing his own explanations of objects and events is ^ 
an ipiportant curricular means. The endS,'for some period of .tiitie, 
would be explanations that .would be divergent- from the best 
simplified scientific explanations. 

Interdisciplinary curricula that use pres6ntatioji of jthe formal- 
isms as a means may not resolve the problem of personal meaning 
and student disaffection. Interdisciplinary curricula thfi^ are" 
organized in Ways not meaningful to students' may not resolve 
these problems. 

A final Question I would raise relates Mo how wje^atlack the ^ „ ^ 
problem of fragmentation. Most efforts that I am aware of, have 
attacked the problem by developing curricula for a single subject 
for one or several years of a student's experience. Would it not be 
opportune- to attack the problem by developing a full program, 
say for fifth graders or for eighth graders? 



DISCUSSION 

Highlights of the Reports dtthe.Discussion Groups 

• The mission of edi^cation includes both general concerns with 
life and special conceiHj^s with discipline and professions. 

• Excitement in learning often stems from the differences between 
and among the various disciplines. 

• Problem-foeused curricula can be used to clarify a discipline. 

• The educational process should emphasize invention— not merely 
affirmation. 

• We seek continued inventiveness* and development aS5»classroom 
activities with teacher and students both active participants. 

• During the '60s the emphasis in curriculum development was 
on scholars and educators— on structure content and structi^pe 
process. The new taphasis should be on students— on structure 
access. V 

• Dealing with problem-solving is a discipline in itself. 
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• The child should have problems relevant to him at his age. 

• Teach children how to deal with problems rather than teaching 
the problems of society. 

• In the university so much time rs spent learning the disciplines 
that the student comes out in th^ world without being able to 
integrate. - ^ 1 

• Interdisciplinary programs must have local components since 
'social utility' and 'personal meaning' change rapidly in time 
and from place to place. 

• Expect and be Willing to make trade-offs. Interdisciphnary 
programs cannot maintain all that is contained in> previous 
programs. 

• Meet th^ challenge of established 'gatekeepers'— the 'givers' to 
teachers and to students, the 'givers' of funds, the 'givers pf 
printed space and the 'givers' of ideas. 

• Rethinking and restructuring classroom management systems 
must accompany innovative programs. 

• Is there a danger that interdisciplinary programs will extinguish 
the disciphnes? - V 

• Ask for competence — not courses. \. 

• Dopnot prescribe the same curriculmif^^or all students at all 
gijade levels — provide alternative pathways. 

• Don't prepare curriculum — prepare instructional units. 

• Do problem-solving skills constitute what we mean by inter- 
disciplinary? 

• Is the drive for interdisciplinary curriculum on^ that comes from 
the needs of the child? Or is it the result of educators reacting 
to the standard curriculum? Is child development theory ac- 
counted for in such a curriculum? Is curriculum reform a series 
of pendular motions ranging from narrow focus on a discipline 

~~tl) a broader intefdisciptihaTy approach? 

• Skills themselves mighj be better learned in a problem-solving 
^ context. 

• "I know I will learn. to add when I need to add, but how will I 
Icnow when I need to add?" (child to teacher). 

• Question: Has there eve?» been an effort Jo start at kindergarten 
and write the whole package? 

Answer: A group at the Uqiversity of^^Rome is working on a 
totally integrated inquiry-oriented program. (See SCIS news- 
letter, Falla974.) ' 

• The first step is to find out how children learn. 




EVALUATION AND 
CURRICULUM 
DEVELOPMENT 



Condensation of Some Thoughts Concerning Evaluation 
and Cuiriculum Development. Robert Karplus* 



The basic ingredients of evalflation are an ©tr^rvation and a 
judgment. All decision-making involves evaluation in some way. 
Evaluation is a part of everyone's daily life. 

Evaluation of individual students is a concern of the classroom 
teacher. Evaluation of groups of students, with data treated sta- 
tistically, is the concern af curriculum specialists. Standardized 
tests, which are the concern of school administrators and the 
general public, are of no value, or possibly of negative value, to 
curriculum specialists , because standardized tests are' rarely re- 
lated to relevant curricular content, reqiuire a great deal of read- 
ing by the test-taker, and discourage thoughtfulness. 

The most controversial aspect of education is the value system 
within which the judgment is made. One approach is to identify' 
educational objectives, perhaps in behavioral terms, and to use 
studems* average progress as a yardstick for making judgments. 
This procedure is limited because objectives for many cognitive 
and effective aspects of a teaching program can never be con- 
structed. 

( 

*Full paper — page 47. 
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A second approach to defining the value system is throiig^ im- 
plicit agreement among members *^of the development t^anxv The 
instinctively shared Valffesr, a 'platform' (Walker), can eacoinpass 
many more aspects of a teaching program than can a list^ of opjec- 
tives. A platform complemec^ts the objectives apptoacli. My 
personal preference is to minimize common basic outcomes (ob- 
jectives) and maximize the freedom for individuals to develop and 
pursue their own objectives. • 

'Formative evaluation*^ (Scriven) based on the value system 
determined explicitly, implicitly, of in gombinatiqn^, is useful in 
improving the course while it is under construction. In formative 
evaluation, interviews, conversations arrd classroonji observations 
are likely to be more informative than the usual testing approach. 
All members of the development team should participate in forma- 
tive evaluation. > 

'Summative evaluation' assesses the overall vajt^ie of a new 
course after it has been completed. This is an ambitidus task which 
calls for defining values o-utside those selected by tjie developers. 
It has been suggested that sufnmative evaluation bj^ pierely a fact- 
finding activity (thus avoiding value definition), jo/.that it be *g6al 
free' (Scriven) with the evaluator applying his oysrij/yalue systeni. 

The usual experimental design witlj experii^i^ntai and control 
groups, and pre- and post-tests — called the 'agricultural paradigm' 
(Parletf) has limited value compared to 'illumi'|l^tiVe evaluation,* 
a more clinical procedure in which observatip:ijs and interviews 
are used, as well as tests, ^to probe the many agjjepts of a program. 

•^Illuminative evaluation is geared, to identify both short-term 
outcomes and potential long-term influences, ffjough the lack of 
educational theory makes it impossible to *j^Ktrapolate reliably 
into the future. f ■ 

Another dichotomy is 'public' and 'privatjB-' evaluation. Public 
evaluation is an activity wholbe results are Uged by a professional 
group and which must* be communicated, usually through journal 
publication. Private evaluation is intended for the use of the 
evaluator and his close associates. It is the vital component of 
successful curriculum development. ; 

Public evaluation in curriculum development is likely to be 
counter productive. All real decisions are based on private eval- 
uation. Public evaluation is an after-the-fact rationalization. 
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REACTION 

Condensation of Value Systems, Approaches, and 
Accountability— a. r^sporise to Robert Karplus's pagfir. 

' H. Russell Cort, [r.* T 

As a researcher and'evaluator. I find myself in essential agree- 
ment, with some pofnts made by Karplus,^ confused about the 
purpose of some, and disturbed about the strav^-man quality of 
others. . i 

The fssue of evaluation is not whether it is done or not. but how. 
by what rules of evidence, and according tj> whose criteria. Values 
are always present and "affect what one observes, interprets, and 
decides. .For this reason it is appropriate to have an outside person 
involyed in formative'evaluation. J • , 

The basic problem 'of evaluation is^o determine ho w^ you knd^ 
whether something i^ or is not — how much or what kind of evidence 
do you require to decide that a student has jnastered something. 
^ The foremost problem is deciding what questions are iip'portant 
to answer within the limits of time and resources. The value prob- 
lem becomes -more qvident as you get doWn to consAiering what is 
j^^orth evaluating and how mucH it is worth. The teacher, for ex- • 
ample, must trade-off amount of masterjj desired against interest 
or motivation, since one level of mastery may enhance retention 
but a slightly reduced level ma^enhance continuing interest in 
the.subject. 

The most important practical problem is not behavioral objec- 
tives versus a meta-language among the (development team, but 
determining users* needs. An ex^luator wants to. know what are 
the users priorities with respect to quq.stions and information, and 
wh^t are their criteria of success and effectiveness. ^ 

I think the public/private dichotomy is somewhat a straw man. 
Public evaluation need not be counterproductive; private evalua- 
tion could be misleading^nd negative in'its consequences. 

The developer of a curriculum may have a''$et\of shared values* 
about the materials developed. However, once in public use, the 
curriculum becomes subject to use and judgment according to 
value systems beyond the developers control. Perhaps a useful 
function of formative evaluation is to bring a wide range of'values 



*Full paper — page 52/ 
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'to bear so the designers can decide what they want to do about 
ariticipated reactions. 

The field of evaluation seems to suffef" from a dearth of. good 
examples and from a plethora of models. It sounds as though I am 
sujggesting .that evaluation, as an operation and a process, now has 
sufficient constructs, models and methods to proceed in straight- 
forward, effortless, or automatic fashion to. support curriculum 
development and implementation effectively at any stage and at 
no great Cost. 

Not necessarily so. Evaluation still has basic design problems'to ' 
' confront anJilogous to those of curriculum design. It seems that 
curriculum dei^ign wrestles with the perennial questions of: 

What >o teach? 
When to teach? 

Haw to teach?. • " ^ 

Similarly, evaluation perforce addresses the question of: 

What to observe or measure? 
^ When to observe? 

* ^ How to observe? 

I have found myself pondering the questioi^ of accountability' 
in curriculum devqbpm^ent. To whom is the curriculum developer- 
.accountable, and for.what? 

Part ©f the probleiA here comes about i^om the concept of ac- 
countabililyr A perusal of the literature does not induce confi- 
dence that there is a universal, mutually shared^^fcform here. 

in. any case, I smuggest that one form of accountaoility in curricu- 
lum development consists of obtaining and using information' 
about students needs and abilities for different age levels and 
backgrounds. Determining teachers' needs and abilities is another. 
^Further explication of the performance characterist'ics of materials 
is a third. V * 



DISCUSSION , " ^ 

Highlights^af the Reports of the Discussion Groups 

• There is need tor good hard evidence that the curriculum you 
are concerned with is paying off. 
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The greatest threat to curriculum development is the lack of 
good evaluative data. - ^ 

Developers' evaluation may be different from'that of the user. 
'What kind of evidence is likely to be copvincing to users? Some 
-suggestions: ' , 

Cost • . 

Attractiveness ^ 

Treatment of controversial issues 

Minority writers in the project > v-^ . 
^^In what sorts of schools trials were made 

Evaluation^ata. External judges may be more important ^ 

Comparison with local, state, or national objectives 
Good symmative evaluation of a new curriculum is very ex- 
peiisive^perhaps $500,000. Is it NSF's responsibility, or the 
developerAff or^some outside. agency's? * . 
Does natioliQl eA^aluatjon meet the needs of local schools? 
Well designed evaluation study does not represent the dichotomies _ 
identified by Karplus. • . " . 

Educational innovation is a continuously dynamic process- 
evaluation also must be continuous. " 
Development and evaluation are separate functions, but, eyal- 
uatoj;^ and developers must interact. ' / 

Students tend to give you the answers you Vvant. > 
To insure teacher cooperation, involve them early in the^^valua- 
tion process. 

Summative evaluation is not necessarily useful, because educa- 
tion is continuously changing. ^ 
Formal' pencil and paper 'public' examinations are a weak mea- 
sure of a complex set of interactidins. 

Overemphasis on evaluation may result in people fearing to do 

things in education that can*t yet be evaluated. 

How are we going to find some instrument or means to convey 

to the public information as to tfie real impact a project^ is 

making? 

Objective standardized tests are based on a very primitive . 
theory of knowledge. 

Caution: intuition has a way of feeding on itself, so there is 
a need to reconcile subjective evaluations with objective data. 
There is political pressure to show impact in numbers. 'Rate of 
adoj)tion' is less important than effects on students. 
We heed to evaluate the cost effectiveness , of evaluation. Is 
rt reajly worth it? 



9^ 13/CV> 



What is more important— measurement pf achievement of basic 
skills or assessment of studem interest and satisi^ction? 
Evaluation results may be ^sed to convince the public your 
product is good. \ 

NSF might put morfe formative evaluation money into high-risk 
projects. ' \ a 

Formative evaluation is relaftve to the population tested. 
The final curriculum product may be O.K. for the population 
tested but not for other populations. * 

Standardized tests and external exams hinder the implemea- 

tation of a lot of our products. 

Evaluation is toughfer than developmenly^^ 



jDISSEMINATION 



Condensation of Pragmatism— ^The Key to Changing 
' Schools in the Seventies. Ernest Burkman* 

V 

In the early sixties when science (fould do no wrong, the curHcu- 
lum developer who could build a better mousetrap could expect 
the world to beat a path to his door. ^ 

But today many future-shocked Americans want to slacken the 
pace of change, and most have become economic conservatives. 
Science now ranks far behind the three R's on most lists of edu- 
cational priorities. To be a successful change agent one must beat 
a path to the world*^s door. 

I have organized my remarks into seven propositions, each ac- 
companied by a rationale and some implications for curriculum 
developers. ^ 

PROPbSITION 1— Those likely to be affected by a curriculum 
development effort must participate in its planning and execu- 
tion. . ' 

Rationale — Involving many people of many types not only insures 
a curriculum project of important input, but is also the surest way 
to convert doubters into supporters. 

ImpJication— Development teams should be large arid have di- 
verse representation. * 

*Full paper — page 59. • 



ERIC 



15 



PROPOSITION 2— ?ie1d. testing is an act of dissemination as 
•well as a way to collect feedback. p" 
Rationale— Most teachers anjd school districts ^assume that their 
problems are totally unique. Seeing curriculum- materials being 
successfully used in l©cal c/r nearby classrooms is the strongest 
motivation for adoptiop. 

Implication — Field »testing should involve large numbers of stu- 
dents distributed nationally according to population density. 

^ PROPOSITION, 3— The final curriculum product will be sold at 
a profit in a highly competitive market. 

RationgJe — To attract and maintain the c^peration of a first-line 
publisher projects must insure during development that the final 
package makes sense commercially as well as pedagogically. 

, Implication — During developrSent,. pfrpjects must insure- that: 
(1) the price ^of the final package will be competitive, (2) the 
publisher will have thei rights to enough material with sales po- 

' tential to generate a profit, (3) the product will appeal to large 
numlpers of prospective userSv 

PROPOSITION 4— Implementation must not depend upon exten- 
sive modification of school fjicilities or large expenditures for 
equipment. 

Rationale — Future science instruction will be done almost entirely 
in existing buildings and classrooms. School science budgets are 
declining so schools wiH reject any program that calls'* for large 
investments in plant or equipment. 

Implication— Pjajecte should exclude learning activities which 
require large expenditures for implementation regardless of their 
pedagogical advantages. 

PROPOSITION 5— The content of new curriculum materials must 
be consistent with existing course patterns.* 

Rationale — Teacher training and certification, classroom design 
and equipment, graduation requirement^, and other vital matters 
serve a^powerful deterrents to change, so adoption of tatally new 
content thrusts is difficult and unlikely. 

Implication— Projects seeking to infuse new content int(^ the cur- 
riculum should add new parts to olc^courses rather than demand 
or assume course deletions and additions. 

PROPOSITION 6— New curriculum materials and apprOj,aches 
must be useable by present teachers. 

Rationa/e— Over the next several years, relativeJy few new teachers 
will enter the profession, so developers must count on people al- 
ready in the classroom to implement their products. 



Irapfication— 'Projects mus^t temper their zeal to introduce new con- 
tent and instructional procedures to match whkt caii reaiis'tically 
be expected of teacheirs now in the school. 

PROPOSITION 7— Curriculum projects must release their prod- 
ucts at a time of high interest in the type of innovation being 
promoted. ^ 
Rationale— Social conditions, more than any other facrtor, deter- 
mine school curriculum practices. Good matej-ials can stimulate 
or institutionalize directions that are already underway, but 
rarely do they initiate new movements. 

In^;fdicalipn---Projetts that are out of tunen with social conditions 
should not be started, and those that are^in tune should be com- 
jjleted with dispatch to'avoid losing the 'teachable moment.' 



REACTION ' ^ 

Condensatian of 'Pragmatism — The Key to Changing* 
Schools in the Seventies. A Response to Ernest 
Burkman's Paper. E. J. Piel* 

While I agree with the essentials of Dr. Burkman's statement of 
the problems, I am in strong disagi^reement with many of the 
propositions and implications. 

There is no question thiat educational institutions are resistant 
to change. The question is whether we should accept this re- 
■sistance as insurmountable and concentrate on short term success. 

If Proposition 1 is valid — that those likely to be affected by a 
curriculum development must participate in its planning and 
execution — the sixty million or so students in schools must par- 
ticipate in the planning and execution of national curricula. It is 
the students who should be the ones most likely Jx) be affected.. In 
actual practice however, it is often the^ scientists. Science teachers, 
and administrators who are affected and the final effect pever * 
getsjo the students. ' ' ^ 

Another question ariseS on Widespread inclusion of teachers, 
administrators, etc., and that is the question of timing. With the 
present economic situation, it is not feasible to ii^clude large n|im- 

*Full paper — page 62, 
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bers of these people in curriculum development at planning phase 
when the philosophy, objectives, and approg^Eh are usually set. 

And so while I ^gree with the proposition, if it includes students 
^ and eliminates the word must, I have strong reser.Vationss^s to the 
rationale and implipations ajhiid the economic feasibility if carried 
to any reasonable conclusion. ' ^ 

Proposition 2 is ^straightforward and logical. Field testing is 
indeed an act* of^dissemination as well as a way to .collect feed- ; 
back. My dnly cbWcerh here is the realisrti of field testing with large 
numbers of students. The larger the number of students involved, 
the greater th^ variety pi observers (or filters) through which the ^ ^ 
>y • feedback mqst be returned and the less vilid such feedback be- 

' . comes. It 'would seem that a small number of feedback centers, 
chosen for their resistance to the Hawthorne Effect, might be a 
more feasible way to o^btain valid feedback while including large ^ 
numbers in a ^Second phase to develop a firm dissemination base. 

Proposition 3— Curriculum projects must specifically design j 
their final product to be sold at a grofit in a highly competitive 
*- market is a proposition up with which I will not put. I still be- 
lieve that curriculum projects must specifically design their final 
J product'k^ to meet the educatiorfal needs of th^ cortinfunity for' 

which they^ are being designed. This is the major criterion. One 
* of the constraints is that it must be sold at a profit ifi a highly 

/ competitive market. • : 

While I object to the proposition, I can agree with the implica- 
tfon -statemeilts with* reservations. They are that projects must 
accept some but not wbotever constraints to insure that th^ com- 
mercial selling price will be competitive, publisher will have 
exclusive sales rights, and that the final package will have reason- 
able numbers of sales. 

While I agree in principle with Proposition 4 — most projects 
should refrain from developing curricula which require large 
expenditures for new equipment — there would be little progress in 
the entire area of computers in the curriculum if this had been 
folloWed^y all curriculum projects in the past. 

CurricuHgn projects involving computers would not be as far 
along as^they are if it were not for USSe and NSF support of 
projects which did require large expenditures for new equipment. 

It is true that the computer manufacturing companies have also 
.pushed for this acceptance. It is also. true \hat the chaotic situa- 
tion regarding educational computing facilities on college cam- 
puses is due to the fact that the introduction of computers to 
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colleges was through the' manufacturers^ rather tj ian t^hrough 
curriculum reform. / * 

To exclude learning activities that have pedagogical advantages 
is to develo'^p nothing new if it, costs money. When a school. ad- 
ministrator* say^ "I like? your program but it costs too much" 
wha*t he really means is ";I don't like your program enough to 
spend the money pri it." 

Proposition £1— The content of new cui'ricultim materials must * 
be consistent with existing course palfterns. — like ipany of*the pre- 
ceding ones accepts th^e status quo as correct and irrefutable. If 
we really believed thaf; ripne of us would Be her^ today. I would 
prefer to see the fedeV^l government supporting a number of new 
thrusts at changing existing course patterns (just to see^ ^hat 
happens) than to support only programs which result in little nibre 
than a text revision.* ' ' 

0 

A survey of two schools in the immediate vicinity of my office 
indicates the Edition of over thirty c6urses to the curriculum 
since 1970. , • ' 

f While many of tjiese courses might be considered as *mickey 
mouse' courses, the point is that schools are willing to put in new, 
courses. Interestingly, these ar'e^ schools which have consistently 
faced the problem of voters turning 'down budgets during these 
sametfive years, as wejl as in previons years. 

While I agree with the rationale of Proposition — New curricu- 
'lum materials and. .approaches naust be useable by present 
teachers — that relativjely few* teachers will enter the profession, I 
cannot accept the cTOCept that projects must match what can 
realistically be exp^pted of teachers whose t/aining and ex- 
perience ended in 1970.1 Curriculum change should be the impetus^ 
behind the re-educatioh of these teachers. The implication here 
should really^ be thatj jpfiore mon^must be spent in teatfher edu- 
cation for the purpoae |i| implementing new curricula. 

It is good to hear Proposition 7— Curriculum projects must 
release their final prpqudts at a time of high interest in the type 
of innovation being , promoted — that we are still interested in 
promoting innovatijOJxJSi^However, to say that we will time the 
release of final pr(^1ii||ftts at a time of high interest is again to 
assume that our finfip^i /giroducts will not be leading the changes in 
schools but following tliem. ^ . 

If education in igsijl jis totally out of tune with social conditions 
{which I suspect it vVijilli be), and we are to agree with Propositions 
J to 6, which tend tp Icfefep us on the narrow track of the status quo^ 



then curriculum development will also be out of step with social 
conditions and therefore, according to this statement, should not 
be started. ^ 

If, as Dr. Burkman says in his concluding remarks, most of the 
world's best science curricula are found on library shelves, hnd 
not in classrooms then we should concentrate our efforts on 
getting them, off the shelves, not on developing second or third 
rate programs just^ecause tWy will sell. 

This then is the problem which we as curriculum developers and 
the National Science Foundation face, v 

Shall we: « 

» 

1. Work to develop curriculum programs which will show the 
way for the next decade? 

2. Work to develop curriculum programs which will not he 
very innovative, but which will sell? 

3. Concentrate our time, effort, and financial resour^^es on 
getting the best science curricula of the past decade off the 
shelves and into the classrooms? 

4. as we recall from sov^pOf the poorly written texts of ^he 
nineteen f-ifties;irone of the above? 

These are some of the problems with which I suggest that^we 
wrestle with during the remainder of this session. 
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DISCUSSION 

Highlights of the Reports of -the Discussion Groups 

• The updating process itself creates involvement. G^t teachers 
and students to do it, but give them gindehnes to minimize 
downgrading. ^ 

• How about, unshelving some 'best' projects — update and mod- 
ernize. * w 

• How can information on results of research on how children 
learn be disseminated? 

• Share information among research projects. 

• Share information from research projects* with curriculum 
projects. 
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Develop a strategy for working with users (teachers, admin- 
istrators, etc.) 

Share information among government agencies (NIE, NSF, 
USOE) 

Develop links with state departments of education. 
Collaborate with professional, disseminators (industry, busi- 
ness, schools) 

Project developers should share *tricks of the trade' possibly 
thiough a newsletter. 

Don't do a h^ard-sell job. Your product should meet aV^jegd in 
schools, andi when they come to you, turn them on to the way 
your materials should meet their needs. 

Time is ripe for change. Teachers have to be more accountable 
^nd need liew ideas. Students are looking for more electives. 
Involveiyent changes perspective. 

Use museums as a third road alternative to Burkman and Piel. 
Museums are — 

— excellent sites for teacher education 
— potential alternate school systems 

—potential solution to the problem of high cost of equipment. 
Sopfie projects should be kept alive long enough for their in- 
fluence to be felt gradually. 

Iilnovation alone is easy — you can easily make a better course. 

pissemination alone is easy — go with what is most popular. 

The hard job is to disseminate a desirable innovation. 

Public^idesires are very conservative — the 3 R's and a biology 

course that will get my daughter into medical school. 

Should NSF and USOE support projects contrary to the public 

mood? 

Communicate with spot TV commercials." 

There must be continuous linkage between the developer and 
the user. 

If y6u don't get the program into the school, the change will 
not be m&de. The schools may change the program, but you 
may like what the school did better than what you did. 
If a product has good characteristics *the public will find and 
adopt it. ^ , ^ ^ 
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The meeting culminated with discussions of future needs and 
opportiinHies in pT'e-college science education. The discussions 
centered on exchanging ideas and sharing views on science edu- 
cation for the future. As Dr. Raymond liannapel, NSF, who chaired 
the final panel session, put it, the dispussions provided an oppor- 
tunity for "raising our collective consciousness as to what some 
of those [future] opportunities might be.*' 

The discussions of the future started in small gtoups and con- 
tinued in a final plenary sess^ion at which a representative of ea^ch 
group served as a member of a panel. Some points that had been 
considered iif earlier sessions of the meeting were discussed 
again. However, a number, of jaew themes emerged. The new 
themes related mainly to the changing nature of schools and of 
children's educational experiences. 

The school child of the seventies, as contrasted to the 
child of fifty years ago, is rich in information but poor 
in experience. Schools need to take this into account — 
capitalizing on the child*s store of information and pro- 
viding rich experienc;jBS for him. In using experientially- 
rich facilities within the community, one should start off 
with the assumption that the child can take active re- 
sponsibility for his own education. As alternative educa- 
tional resources are developed within the community, 
one of the roles of schools and educators could be to 
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orchestrate for the students the use of these various 
facilities. 

Schools are changing. Curriculum developers in the '60s 
were reasonably confident that they knew what a school 
was and what schooling was. They could design a cur- 
riculum package, and by changing the set'of ihstructional 
materials, they could change the instructional experience 
of the students. — In the 70's currit:ulum developers can 
no longer make sucn assumption^. Equal opportunity 
programs, special programs for the disadvantaged, 
multiliftgual programs, and so on, are probably having 
as much or greater impact on schooling as are the cur- 
riculum developers. 

Educational effectivei^ess seems to come in the follow- 
ing order: first the family, then the neighborhood, then ^ 
the mass media, and finally, the school. Curriculum de- 
velopers? in the future should be concerned with more 
out-of-school educational experiences — with more al- 
ternatives to the classi*oom. 

There are many reasons why schools are not necessarily 
the best places, and certainly not the only places, where 
students can have an effective introduction to science/ 
More emphasis should be given to alternatives to the 
classrgom. 

* I 

Museums can provide rich educational experiences for 
children. They can be desigi^d to provide a variety of 
individual and school and non-school group experiences. 
They can provide experiences that schools find impos- 
sible or loo expensive to provide. They can be used for 
interdisciplinary activities, for example*, weaving to- 
gether studies of perception, optics, and wave motion 
and relating them to the study of art. j| 

Because the field of education is in great turmoil, it is 
important that support of curriculum development in 
the future include support for some high-risk, pioneer- 
ing programs so that we may be prepared with highly 



innovative materials as new directions and perspectives 
in education emerge. ^ 

There is a need for finan^al' support of studies on 
learning and teaching, since there is some concern today 
that perhaps the laws of learning are not generalizable 
across all subject fields and across all disciplines. 

Teachers are going to heed some special kinds of train- 
ing that are different from those they have been getting 
up to this time^. -Much inservice education is going to be 
necessary. Very little study has Vet bgen made as to 
what should constitute these new program^ 

^ There is a need for regional science centers to serve a 
training functipn for teachers, a distribution function, 
and an assessment function of what is 'actually going on 
in schools. ^That • kind of information is not very yvell 
known at the present time. 

Teachers and teacher educators are not sufficiently in- 
fbrmed about current science curriculum projects. There 
is a need to improve information delivery systems 
through regional science centers, educational extension 
agents, and ads on commercial anji^ educational TV. 
Saturday morning TV would be a useful medium to get 
information to students. 

How in the world can alternative^Mn education be imple- 
mented if nobody knows that alternatives exist? Edu- 
cational television, travelling science fairs, conferences 
and other modes should be used to/inforxn the public 
about alternatives so that peo^e will stai^U) ask, "Why 
uon*t we have those things in g(Be schools?" ^""^"""^^--^ 

Look back to seek guidance for the future. A study might 
be commissioned to look at the whole science curricu-*^ 
lum effort for the past 20 years to see what the impact 
of individual projects has been on the schools, and even 
more important, what the impact has been on commer- 
cial publishers' programs. Probably new ideas developed 
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in the curricplum projects have seeped into other pro- 
grams, i ^ 

I 

Some very big new programs have n^t been widely used. 
A study migmt be made to determine the reasons some 
f)rograms wer^ adopted and others not. 

\ 

Curriculum developers need to hav.e a continuing ex- 
change ' of information and ideas. Communication 
through newsletters and periodic meetings can stimulate 
curriculum innovation. 
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Science, Schooling, and Society: The Sea^xb 
for an Integrated Curriculum ^ 

Peter B.Dow 



The topic "for 4his meeting *'The Challenge of Developing an 
Interdisciplinary Curriculum/' focuses our attention on one of 
the most persistent problems that educators face: the fragmenta- 
tion of knowledge. It is not a new concern. Alfred North White- 
head, writing in 1912, inveighed against what he called "the 
fatal disconnection which kills , the vitality of our modern cur- 
riculum." Said Whitehead: 

There is only one subject-matter for education and that is Life 
in ^ all its manifestations. Instead of this single unity we offer 
children—Algebra, from which nothing follows; Oeometry, from 
which ^nolhinp follows; Science, from which nothing follows; His- 
tory, From/'CVhich nothing follows; a couple of languages, never 
masteredj-and lastly, most dreary of all, literature, represented by 
plays Shakespeare, with philological notes and short analyses of , 
•pldt.^nd character to be in substance committed to memory. Can 
f^stffh aj^t be said to represent Life, as it is known in the midst of 
the living^^of it? The best that can be said of it is, that^ it is a rapid 
table of contents which a deity might run over in his mind while he 
wes thinMng of creating a world, and had not yet determined how to 
pfit it J^ogether.^ ^ — ^ 

^Whitehead, Alfred North. The Aims of Education and Othef Essays. The Mac- 
Millap Company. New York, 1929. pp. 10-11. 
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.What would Whitehead think if he could examine our curricu- 
lum today? I suspect he would be further dismayed, In an age that 
is generating new knowledge at an incre^lngly rapid rate, we are 
adding endlessly to the list of available subjects while neglecting 
to ask what organi-zing ideas^ and principles give meaning to the 
academic quest. A glance at any college catalogue quickly reveals 
that we have allowed this growth to spread until it threatens to 
destroy any unified conception of a liberal education, The symbol 
of this disintegration is the modern multiversity, the knowledge 
factory that offers everything but espouses no unified conception 
of an educated human being and no coherent vision. for the future 
of mankind. ^ 
It may be useful at this point, to remind ourselves of the his- 
toric tradition upon which our conception of a liberal education 
rests. From the beginning Americans have equated education with 
the preservation and improvement of society. Thomas Jefferson ^ 
eloquently expressed this view in a letter to Joseph Willard, 
President of Harvard College, in 1789: 

It is for such institutions as that over which you preside so 
worthily. Sir, to do justice to our country, 4ts productions, and its 
genius. It is the work to which the young men, whom you are form- 
ing, should lay their hands. We have spent the prime of our lives 
in procuring them the precious blessing of liberty. Let them spend 
their lives in showing that it is tlie great parent of science and of 
virtue; and that a nation will be great in both always in proportion 
as it is free. 2 ^ 

Underlying Jefferson's commitment to education was the conviction 
that a free society must proihote the liberal education of all its 
citizens, and that those citizens in tupn will, through the cultivation 
of intellect, virtue, and a love of liberty, perpetuate the free 

society. 

Half a century later another famous spokesman for the Ameri*- 
can educational ideal, Horace Mann, sought to extend the Jeffeir- 
sonian vision of the relationship of education to society when he 
took over responsibility for the Cotnmon Schools of Massachusetts. . 
Sacrificing a brilliant law career to become secretary to the newly ^ 
^formed State Board of- Education, Mann remarked, "I have aban- 
doned jurisprudence, and betaken myself to the larger sphere of 
mind and morals. "3 Knowledge alone was not enough, in Mann's 

r 

^Lee, Gordon C. ed. Crusade Aaainst Ignorance: Thomas Jefferson on Educa- 
tion. Bureau of Publications, Teaches College. Columbia University, 1961. p. 19. 

^Cremin. Lawrence, ed. Horace Mann: The Republic and the Schocjk. Bureau cf 
Publications, teacher's College. Columbia University. New York, 1957. p. 3. 

^ " 32 
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view, because it could he used for both good and evil. Tq retnedy ' 
this, he proposed Common Schools where children of all, back- 
grounds learned together and academic achievement was sub- 
ordinated t-o the promotion of human values. **Never will wisdom 
preside in the halls of . legislation and its profound utterances be 
recorded on the p^ges of the statute book until the Common 
Schools sj[iall create a more farseeing intelligence and a purer 
morality than has ever existed among the communities of men/* 
he said.^ Such a faith in the power of public education to instill 
civic virtue 'should give us pause in the current political qlimate. 
Hqw inadequately we educators have performed our task! 

Who speaks for the aims of education today? Our voices seem 
timid when compared to our forebears, and are easily drowiied out 
by the demand for accountability and efficiency, the quantitative 
values of a technological age. We have to look beyond our borders 
to men like Ivan^lich andii'aulo Friere to find men today who can 
articulate a moral imperative upon which to construct a socially 
responsible curriculum. Our most inspiring educational philosopher 
is still John Dewey, who launched a quiet revolution in American 
education with his Pedagogic Creed set down in 1897: 

I believe that all education proceeds by the participation of the 
individual in the social consciousness of the race. This process be- 
gins unconsciously almost at birth, and is continually shaping the 
individual's powers, saturating his conscioiusness, forming his habits, 
-training his ideas, and arousing his feelings and amotions. Through 
this unconscious education the individual gradually comes to share 
in the intellectual and moral resources which humanity has suc- 
ceeded in getting together. He becomes an inheritor of the funded 
capital of civiliz^ion. The most formal and technical education in 
the world cannot safely depart from this general process. It can 
f only organize it or differentiate it in some particular direction.^ 

Here Dewey reiterates the underlying^assumption that has gov- 
erned the evolution of American education since Jefferson's time: 

f * 

the training of mind and the shaping, of character cannot be divorced 
from a consideration of the values of the society of which the edu- 
cational system is a fundamental part. Only when we can properly 
frame the sociat^^d moral imperatives of our own time will we be 
able to solve thevproblem of the integrated curriculum. 

Having said ^11 this, let us now consider where we are. Those 
of us who have participated^in the curriculum movement over the 

Mbid. p. 26. ' 
sDworkin, Martin S. Dewey on Education. Bureau of ^Publications, Teacher's 
College. Columbia University. New York, 1959. p. 19-20. 




past decade have seen a profound Change in the orientation of cur- 
riculum makers during this periodl* In the wave of science-based 
curriculum projects that followed t^jie launching of Sputnik in 1957 
there was little explicit attention given to the social purposes of 
instruction. The emphasis in those yiears was on the transmission 
of knowledge in the most economical form through the identifica- 
tion of central ideas, and on the invention of pedagogical tech- 
niques that supported and reinforced the child's natural curiosity 
and desire to learn. One of the mdst influential thinkers of the 
^ period, Jean Piaget, turned the alleation of curriculum-fnakers al- 
most exclusively, to the child's processes of cognitive growth', and 
to individual differences in learning style. Another, Jerome Bruner, 
wrote an immensely popular book. The Process of Education, that 
stressed the most effective ways of ())rganizing the transmission of 
^'knowledge while making only passing reference to the social 
consequences of instruction. / 

No one during those years talked much about the emergence of 
the child as a social, creature. The failure of these early reformers 
to consider the moral dimension of learning has left us with some 
troubling problems. While the curriculum leaders of the sixties 
were enormously effective in extending the scope of the curricu- 
Jum to include many new areas of kno-^^i^dge, and were .equally^ 
inventive ija developing new pedagogical approaches and tech- 
niques, they neglected to ^evolve a unifying social purpose for 
their reforms. Thus, inadvertently, they contributed to the curricu- 
lum fragmentation that ^e face today. The growing disaffeciion 
of both high school and college students with a curriculum that 
fails to relate learning to real-life problems is a measure of how far 
we still must go to close the gap between curriculum development 
and social need. 

Now we are in the midst of a second wave of curriculum reform 
that is attempting to respond to these new demands. Where 
physics teachers were once content to enliven, the teaching of 
their subjeui by having students do ptiysics' rather than read, 
about it, now they are striving to help students' 'do something 
useful with physics,' like unscramble a traffic jam or design a 
better security system. Or where before it was enough to examine 
pond water to expose the mysteries of the ecosystem, now students 
are asked to apply such knowledge to solve pollution problems or 
to debate questions of environmental planning. Even in the social 
studies classroom, where it used to be sufficient to contrast 
comparative political structures or explore the diversity of cul- 
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tural patterning, teachers are now pressed to think about how new 
knowledge about human behavior can bQ used to construct a mdre 
liveable world. In these new efforts, we can begiia to discover the 
broad outlines of an approach to Curriculum-makina that relates 
the teaching of *disciplines' to the needs of society. ^Such an ap- 
proach cpuld chart the path to a more integrated curriculum* 

Both the excitement and the magnitude of the task we face is 
perhaps best iflustrat»d by examining a specific case. In 1970 a 
group of scholars, teachwML and curriculum writers assembled at 
Education Development Gfewer in Cambridge, Massachusetts to 
begin designing an interdisciplinary social studies course for liigh 
school students entitled Exploring , Human Nature. Our intent, 
broadly speaking, was to create a course that would draw upon 
both natural anjd social science disciplines — particularly biology, 
anthropology, psycliology, and sociology — to help students 
understand, on the basis, of the best current scientific thinking on 
the subject, what it means to be a human being. In particular, we 
hoped to devise a way to help adolescents understand themselves 
as individuals passing through a particularly significant stage of 
the human life cycle, as participants in a society that has distinc- 
tive norms and values, and as members of a species having some 
^eneralizable traits that are a product of a long evolutionary 
history. Implicit in our approach, and in our desire to design this 
course, was the assumption that knowledge of human behavior 
Was an important psychological anchor for adolescents growing 
uffii^ a world of flux and rapid social change. We hoped that such 
a course would provide students with an appreciation of their awn 
' . psychological uniqueness, an awareness of the kinship they share 
with other members of their own culture, and an understanding 
- of the biological a'lid behavioral characteristics that unite the 
human race as a whole. Like Leon Eisenberg, we believe that an 
enlarged sense of human iduiiiity can incregyge^ur potential as 
human beings — can help us to become more fully human. 

It did not take us long to discover that no academic Hiscipliue 
within the natural or social sciences was adequate to cope with the 
questions we wanted to raise. As Irven DeVore, ofae of the principle 
developers qf the course, is fond of pointing out, most of the 
interesting issues in the study of human behavior falf between 
the disciplines. Take a simple behavior such as a two-^rear-old 
speaking, for example. To begin to understand so basic a be- 
havior — one would have to consult at least half a dozen sclj^olars: 
a physiologist to find out about the anatomy of vocalizatiort; a 




biologist to learn i^Jbout differences between verbal and non- 
verbal coniniunicattdn; a child-development specialist* to under- 
stand stages of d^>^^lopment; a social-psychologist to study ^ta, 
process of acquisitji^|n; an anthropologist to examine cultural dif- 
ferences; a linguiafjto explore matters of syntax and structure; 
and so forth. Cle^^^, tlie university wa^ organized in}o a set oi 
arbitrary departmefi|s^ that bore littlf^ relationship to the problems 
We wanted to discu^.*^' ^ /I 

Having found t]^ conventional disciplines to be of marginal 
usefulness to us ij(^|iraming the problems and devising the con- 
ceptual frameworj^T [for our course,,, we proceeded to organize 
materials around f|3ues that appeared to be interesting to stu- 

- deirts: dhild-reariifj^ practices, male-female differences, love and 
affection, expressidiis of fear and anger, pareril-offspring conflict, 
etc. and then sougiit support from different departments of the 
university to ciariiy how we were approaching these questions. 
It soon became apparent that academics fron> different .disciplines 
often use different ^ords to discuss the same or nearly the same 
phenomena, and th^t these words are invested with quite different 
associations and nie$nings. A biologist, for example,^ speaks of 
'bonding' when exaiaining relationships between male, and fe- 
male or between parent aid offspring, while a psychol'ogist may 
use words like *lov^' or ^ttaqhment.' Sijnilarly a psychologist 
talks of *anxiety' aind 'hostility' when discussing conflict between 
individuals, whil^ an anthropologist is inclined to use terms like 

. 'dominance' and ^aggression/ Accomodating these differences in 
usage is no easy matter for they often reflect fundamentally dif- 
ferent viewpoints about the way a specific behavior can be ex- 
plained. 

Still another prpbl^m that has plagued our work was the dis- 
covery that the 'disciplines' represented not only separate languages 
and tools of analysis, but also drew upon bodies of data that did 
not overlap. Evolutionary biologists are free to do their work un- 
challanged so long a$ they confine their investigations to animal 
behavior, but let them not intrude upon the study of human beings. 
Anthropologists are safe while examining preliterate cultures, but 
suspect w^ien t^ey put their tools to work on recorded history. 
Psychologists rftay examine interpersonal 'behavior^ but let them 
not extrapolate their findings to a theory t)f society. So Icyig as 
the academy supports the autonomy of its departments and fails 
to encourage cross-disciplinary study of similar phenomena, aca- 
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demies from different intellectual traditions will be deprived of the 
opportunity to learn from each other. Needless to say, both scholar- 
ship and the cause of general education will be impoverished as a 
result. 

But the deepest and perhaps most troubling problem we have 
encountered has been the struggle to accomodate the differences 
between the natural and social sciences. The cleavages between 
these two areas of knowledge run so deep as to constitute, in ex- 
treme cases, fund^entally different points of view regarding the 
nature of man. Our encounter with these differences has emerged 
from our effort to combine perspectives from biology with in- 
sights drawn from anthropology, psychology, and sociology. At 
the heart of thes^^differences seems to be conflicting opinions as 
to whether human behavior can be understood with reference to 
the biological process of e>/oJution by natural selection. On one 
side, some social scientists go so far as to assert that cultural evo- 
lution proceeds quite independent of biological factors. An ex- 
treme exponent of this position is Leslie White. In his book, Evo- 
lutiontof Culture, he puts it this way: 

. Although culture^is produced and perpetuated only by the human 
' species and therefore has its origin and basis in the biological make- 
up of man, in its relation to human beings after it has come into 
existence and become established as a tradition, culture exists 'and 
behaves and is related to man as if it were non-blplogical in char- 
acter. . . . (we wduld not) be aided in our study of culture in the 
slightest by taking the human organism into consideration. . . . tKe 
biological factor is irrelevant, ^and consequently it should be dis- 
regarded.^ - , « 

On the other side, in The Territorial Imperative, Robert Ardrey 
proclaims the primacy of biological forces in understanding human 
beliavior: ' * J ' . 

I submit that the continuity of liuman evolution from the> world 
of the animal to the world of man ensures that a human group-in 
possession of a social territory will behave according to the laws of 
the territorial principle. What we call patriotism, in other words, * 
is a calculable force which, released by a predictable situation, will, 
animate man in a manner no different from pther territorial species/ , 

^^As quoted in: Smuts, Barbara D. The Croisdisciplinary Aspects of Exploring 
Human Nature. S6urces for Teachers, ed. by George Goethals. Education Develop- 
ment Center, 1974. p. 108. 
Mbid. p. 109. 
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For our purposes, neither vie-w is satisfactory for it is precisely 
in the interaction of biology and culture that some of the most 
interesting insights into human behavior emerge. Take weeping, 
for -example. Biology tells us that the female hormone estrogen 
predisposes a person to cry, and, not surprisingly, it turns out that 
women in all cultures, so far as we know, are inclined to weep 
more than men. At the same time, we know that different cultures 
develop different expectations about when weeping is appropriate, 
some tending toward stoicism, others inclining toward emotionally 
expressive behavior. This can lead to wide variations in weeping 
behavior among men and wpnagfi. Men in some cultures are likely 
to ^weep mbt^e than women in oihej cultures. Both biological and 
environmental influences seem equally important in this case. 

Perhaps an even more interesting example for our purposes is 
what interdisciplinary studies are now revealing about the natare 
of learning. Stimulous response psychology has told us for years 
that rats and^ presumably, human beings are shaped almost en- 
tirely by their responses to negative and positiAj'e stimulae within 
the environment: they act to seek pleasure an(i avoid pain, and 
can be taught or 'conditioned' to do anything, simply by careful 
manipulation of the external stimulae. Recent experiments, how- 
eVer, reveal that the rats can be taught to avoid food of a certain 
flavor when experiencing artifically induced nausea several hours 
after eating, but that they never learn to associate food of a par- 
ticular size -and shape with delayed sickness. This suggests that 
thf rat brain is not an undifferentiated organisTi shaped entirely 
By the external environment, but it is predisposed by natural 
selection to react differently to different externial stimulae. The 
rafs* response is Iggical in this case, because poison is more likely 
to be associated with taste than with size in the real world.^ 

Extrapolating to human beings, it is reasonable to postulate 
that we, too, are predisposed by our evolutionary past to respond 
differentially to environmental forces, and are not simply the 
passive recipients of stimulous-response shaping. Boys, for 
example; are inclined to engage in rough and tlimble play in all 
cultures, regardless of efforts made to extinguish it, and, as every 
junior high school teacher knows, ihey will often endure consider- 
able punishment without changing their behavior. Similarly, new- 
born infants, as John Bowlby has demonstrated, can elicit differ- 



°Seliginan, Martin. E. P. &^Hager, Joanne L. (ed.)- Biologicai Boundaries of 
Learning. Appleton-Century-Crofts. Meredith Carporation. New York, 1972. pp. 
10-14. 
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ent care-taking behaviors from 'their mothers through different 
^*types of crying that appear to have an Evolutionary origin. This 
suggests that Dr. Spock may advise an American woman to behave 
quite differently toward her baby than a bushman mother does, 
but it is not likely to alter the behavior of the baby very much.^ 

Still another example of the power of combining insights from 
'both biology and social science in an examination of human be- ' 
havior is in the study of pair bonding and the evolution of the 
human family. While anthropology exposes us to the diversity of 
forms that family structure takes around the world — monogomy, 
polygany, polyandry, etc. — social science alone cannot explain the 
persistence of the family as the fundamental unit of society, 
despite profound changes in culture and despite numerous experi- 
ments designed to^ replace the family with other forms of social 
organization* Biology reframes the question and asks, *'Why should 
Natural Selection favor pair bonding between human males and 
females and the investment of energy by males in the care of their 
own offspring?" Even chimpanzee males, our closest primate 
relatives, have no lasting pair bond with females, and make little 
or no investment in the care of the young. Why should human 
beings share with most species of birds and a mere five percent of 
all species on earth the unique adaptation of prolonged paif bond- 
ing between male and female — the basis of the hu^an family? 

By asking the question in this way we can see how biology in- 
forms the social sciences. Evolutionary theory can help us to see 
how over five million years of human evolution selection pressures 
have favored a pair bond between male and female that facilitates 
economic diversity — division of labor for hunting and g^therihg,^ 
for example — and ensures maximum care and protection of the 
young* Clearly, those males who were predisposed to stay with 
females had greater reproductive success, and it was their genes 
that survived. What biology helps us to see is that underlying . 
the surface diversity of cultural patterning lies a set of biological 
forces that interact with culture to produce particular behaviors. 
Thus, by combining the insights of biology with those of anthro- . 
pology we are able to provide students with a more comprehensive 
way of thinking about human nature than any single discipline 
allows us. 

• I hope these examples are sufficient to suggest the excitement 
and the freshness of viewpoint that can emerge from a deliberate 

oMuch of this material is drawn from the Smuts article cited above. 




effort to examine human behavior from new and multiple per- 
spectives. I am sure that many of you have experienced a similar 
exhilaration in employing the interdisciplinary approach to other 
areas of the curriculum that I know less well. I suspect one of the 
most fruitful fields for interdisciplinary curriculum work is in 
environmental studies. Here the natural and social sciences can 
interact to explain the workings of the ecosphere, and to frame the 
crucial issues of our relationship to the environment that must be 
resolved if human society as we know it is-to survive. Books like 
Barry Commoner's The Closing Circle demonstrate the need for an 
o interdisciplinary approach to understand our ecological problems, 
and the tragic results of a fragmented one. His account of the death 
of Lake Erie, for example, is a disturbing demonstration of the 
failure of modern science to cope with real world problems. Com- 
moner blames this failure on the isolation of the disciplines and in 
words reminiscent of Whitehead, criticizes the way we teach: 

Life, as we live it, is not encompassed by a single academic dis- 
cipline. Real problems that touch our lives and impinge on what we 
valife rarely fit into the neat chtegories of the college catalogue, such 
as physical^ chemistry, nuclear physics, or molecular biology, , . . To 
encompass in our minds the terrifying deterioration of our cities. 
we need to know not only the principles of economics, architecture, 
and social planning, but also the physics apd chemistry of the air, 
the biology of water systems, and the ecology of the domestic rat 
and the cockroach. In e word, we need to understand science and. 
technology that is relevant to the human condition.io 

So where are we? I have tried to set forth several propositions 
that I hope will guide our discussions of the development of inter- 
disciplinary approaches to curriculum-making. First. I have arguelK- 
that curriculum design must today, as it always has. spring from 
some vision fot the society that we want our children's children to 
inhabit. Historically, that vision has always been stated in moral 
terms. For Thomas Jefferson ^^it was the preservation of freedom, 
for Horace Mann it was ethical training, for John Dewey it was 
participation in the consciousness of the race, and for ourselves, 
although we don't quite know how to formulate it yet, I suspect 
that\^it is caring for our natural environment and the precidU 
human beings that inhabit it. vT 

Second. I have attempted to point out that while philosophers 
have always stated the^'ims of education in moral and human 

"Op. cit. p. 189. 




tBrms, there seems to be a persistent tendency within the aca- 
demic world to depart from these larger goals in the pursuit of 
narrow and -specialized ends that take the search for human 
understanding away from the problems of the turbulent world. 
While there are those who may justify this in pursuit of some 
higher truth, today, with the escalation of human and environ- 
mental problems increasing at exponential rates, we need more 
than ever an educational system that olaces learning in the service 
of human bein^gs. Can the pursuit of 'knowledge'without regard for 
ita^ social consequences threaten the stability of society as we 
know it? Can technological advancement create an' uninhabitable 
environment? For the first time we must ask such questions. 

Finally, J have sought to demonstrate that ah interdisciplinary 
curriculum can be built that strives to address real life problems, 
but it can be achieved only through a willingness to grapple with 
sonae of the tough intellectual issues that our fragmented aca- 
demic worlis|^ has imposed upon us. Thevdisciplines, as we know 

^ them, are not likely* to go away soon jiist because we pronounce 
them inadequate to o^ur task. Mor will we easily resolve the con- 
ceptual issues that divide them. But by ftss^erting leadership our- 
selves, by framipg problems that engage students and have social 
relevance, and by enticing the'l&est minds in academia to join us 
in the search for more powerful ways of thinking about the central 
issues of modern fife, vye ©an begin to reconstruct the curriculum 
in the schools in ^vays that-t^Rbr the search for knowledge to-the 
pursuit of hiiinan needs, ^ . * ^ 

It will take all the courage and energy we can summon to bring 
abo|it the reforms of which we speak. Scholars and school teachers 
alike are trapped in a conventional pattern of curriculum organi- 
zation that would bend us to its will. And even when we have 
managed to solve the problenri of designing the interdisciplinary 
curriculum, I suspect our troubles will have only begun. We will 
still have the 'gatekeepers* in the schools to face. Recently, I ex- 
amined the materials of a national curriculum project that has 
gone further than most in developing interdisciplinary approaches 
to real world problems. The designers of this prQgram havp man- 
aged to invent ways to integrate the teaching of mathematics, 
simple engineering, -m^ny of the usual topics treated in elemen- 
tary science, environmental studies, and even aspects of geography 

. and the social studies into a series of units that engage students 
across the elementary grades in solving problems such as the de- 
sign of a play area, or making a community more habitable for 
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people on bicycles, or studying the traffic patterns at a dangerous 
intersection. Children, by all account^, are responding with great 
enthusiasm to these activities, and acquiring a variety of problem- 
solving skills: measuring, estimating, computing averages, quantify- 
ing alternatives, analyzing data, making decisions. Teachers of the 
program are ehthusiastic about the success- of this approach. And 
what is^one of the project's most persistent criticisms? Curriculum 
supervisors are skeptical because they cannot identity what dis- 
ciplines the children are studying. 

But we must take heart, and remember that it is our own hu- 
manity and th^t of our students that we seek to rescue frtpm those 
who would wrest it from us and force us to reduce the marveloAis 
complexity of life to a set of sterile categories. Until we do so, me 
only have ourselves to blame for the dehumanization of our eau- 
catioilal system, a system that si|nply mirrors the misplaced prior- 
ities of our technocratic age. Perhaps we can draw inspiration from 
the words of Archibald MacLeish who put our problem well in an 
article for the Saturday Review a few years back: 

After Hiroshima it was obvious that the loyalty of science was 
not to humanity but to truth— its oWn truth — and the law of science 
Was not the law of. the good— what humanity thinks of as good, 
meaning moral, decent, humane— but the law of the possible. What 
it is possible for science to know science must know, what it is pos- ' 
sible to do technology will have done. . . . The frustration— and it is 
a real and debasing frustration — in which we are mired today will 
not leave us until we believe in ourselves again, assume again the 
mastery of our lives, the management of our means." 




"Ibid, p. 180-181, 
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Integrative Curricula 

Response to Peter Dow's, "Science, Schooling and 
Society: The Search For An Integrated Curriculum" 
James T. Robinson 

I will organize my remarks around three questions that seem to 
Ke^plicit in Peter s paper: 

/ — What are the problems we are' trying to solve? 

-^Why do we think integrated or interdisciplinary curricula 

will contribute to their resolution? 
— Will such curricula work? 

The problems 1 find in Peter's presentation that need to be 
solved are as follows. Eirst, w^ have a fragmentation of knowledge, - 
with- its attendant specialization, its lack of direct relevance to 
real-world problems, and the gaps that are left unattended. A 
second problem raised was how to relate the teaching of the dis- 
ciplines to the needs of society. A third issue was the disaffection 
of students with a curriculufti that fails to relate to real life. Fourth, 
the failure to consider the social dimensions of learning, and 
finally the issue of how we can get really different curricula by 
the 'gatekeepers* and into the classroom. ^ « 

In addition to these problems, Peter raised several that relate to 
the development of integrative or interdisciplinary curricula.* I 
will not discuss these issues. I agree with them and feel that they 
need deliberatioa in our group meetings. That integrative curricula 
can contribute to the resolution of the problems to be asked is 
explicitly stated in Peter*s presentation; for he urges that we need 
to "properly frame the moral imperatives to solve the problems of 
such curricula." 

I think- that there are additional problems that need to be con- 
sidered. Integrative curricuLa '^may provide a necessary, but not 
sufficient effort forlheir resolution. 

Student disaffection is an issue that needs more elaboration, in 
my judgment. What students, at what age levels are disaffected 
by what curricula^ under what conditions, and for what reasons? 
We need much more precise information than is currently avail- 
able on this problem to help determine curriculum policy. We 
^Iso need to decide if we care about students reaction to curricula. 
We haven't always considered it worth our attention. I agree that 
the problem is real and important. What I find, however, is that 
the ideologies. of fcurriculum developers usually have more to do 




with {proposals for» solving the problem than does information 
about the problem. I would urge that any single solution, ijncluding 
integrated curricula^be reviewed very carefully before it is applied 
to all curricula, for all students, at all levels — kindergarten through 
graduate school. 

I would like to reformulate the student disaffection question to 
ask, "how does one design a curriculum so it will have personal 
meaning for each student?" This question may need to be answered 
in different ways for different students in different curriculum 
areas. Peter suggests that integrated curricula can contribute to 
solving this problem. He suggests that integrative concepts be 
presented to students in more meaningful ways than can concepts 
from the separate disciplines. However, he seems to accept the 
same overall goal for both' kinds of curricula. This goal is the 
transmission of the culture to the next generation. Meaning, in 
terms of each student, will be enhanced by such curricula; the 
fragmentation of knowledge will be reduced; issues that now fall 
between the disciplines can be considered; and integrated curricula 
can be more effectively related to the needs of society and the real- 
life of the student. 

We can now ask: Will it work? Let me suggest that it has been 
tried. Biology, as a high school course, had iis origins in the decade 
1900-1910 (Hurd, 1961). Hurd reports that "by 1910, anly 1.1 per- 
cent, of all high school students were enrolled in the course." 

When I started tea^ching high school biology my school offered 
botany, zoology, and physiology. It was not until 1956 that a be- 
ginning and advanced course in biology became the life sciences 
offering. Many of the early texts in high school biology were or- 
ganized in groups of practical problems, problems designed to be 
of interest to high school students. This very attempt to solve the 
student disaffection problems of the 1920*s and 1930's in curricula 
was paralleled by the formalization of interdisciplinary biology 
into biology, the discipline. When biologists looked at high school 
curriculum materials in the late 1950's they found the books and 
labs to be obsolete in terms of the discipline. Their correction of 
this sad state of affairs, and it was badly in need of correction, was 
to both up-date the content and to organize the curriculum in terms 
of formalisms that made sense to academic biologists — the struc- 
ture of the discipline. This kind of organization also made sense 
to some students, but many found that the academically organized 
integrated biology curriculum was irrelevant to their real lives. 
An interdisciplinary structure was not adequate to resolve the stu- 
dent disaffection problem. 




The issue I am raising is that I think interdisciplinary struc- 
f tures ace necessary, but are^not iit themselves sufficient elements 
j to contribute to the resolution of the problems Peter raised. We 
also need to give serious consideration to hct^ the curriculum 
should be organized, what are io be its essential means, and what 
are its desired ends. And, I believe, that the qviest;ion may require 
different answers for students at different levels within the edu- 
cational system, 

I suggest that we not consider our job done with the invention 
of new integrative concepts. We need to invent alternatives to an 
academic organization for integrative curricula, alternatives that 
may vary considerably from kindergarten to graduarte school. 

I have raised the issue of means and ends as a problem to be 
considered. Redefining the broad areas of knowledge and trans- 
mitting them to students is implicit in> Peter's presentation, if 
applied broadly. Kohlberg and Mayer (1972) "have recently argued 
that human development, as distinct from cultural transmission, 
- should be the proper aim of education, Piaget (1973) in his recently 
translated book', To Understand Is To Invent, argues that this 
means — traditional presentation of information — reduces "... edu- 
cation to simple instruction, it becomes only a question of *fur- 
nishing' or nourishing" capabilities that are already forified and 
not of forming them." Piaget's position is that logical thinking is 
created through organism-environment interaction (it is not al- • 
ready there], a process that seems to me to be quite different from 
a student appropriating someone else's explanations, Piaget em- 
phasizes this point by stating that **in order to understand basic 
phenomena through deductive reasoning and the data of ex- 
pedience, the child must pass through a certain number of stages 
characterized by ideas which will later be judged erroneous, but 
which appear necessary in order to reach final correct solu- 
tions." (Piaget, 1973, p. 21> To me this suggests that the impor- 
tance of the child's constructing his own explanations of objects 
and events is an important curricular means. Tiie ends, for some 
period of time, would be explanations that would be divergent 
from the best simplified scifintrfic explanations. 

Interdisciplinary curricula that use presentation of the formal- 
isms as a means may not resolve the problem of personal meaning 
and student disaffection. Interdisciplinary curricula that are or- 
ganized in ways not meaningful to students may not resolve these 
problems. Peter has given several examples of the potential ef- 
fectiveness of -a, problem organization, when the problems make 
sense to the target student group. 

ERJC f9 , " 
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A final question I would raise relates to how we attack the prob- 
lem of fragmentation. Most efforts that I am aware of have at- 
tacked the problem by developing curricula for a single subject 
for one or several years of a student's experience. Wauld it not be 
opportune to attack the problem by developing a full program, 
say for fifth graders or for eighth graders? 

I have now raised several issues in addition to those Peter raised 
thatj Jeel must be considered in a search for integrated curricula 
that will contribute to resolving the problems he proposed that we 
need to solve. 

— Who are the students for whom we are designing the cur- 
riculum, what are their interests, their, concerns, and their 
range of competencies? 

—Are integrated curricula appropriate for all of them at all 
educational levels? 

— How should integrated curricula be organized? 

— What ends do we have in view and what means are appro- 
priate for their attainment? 

— Should we try to solve some problems through different cur- 
riculum development efforts, suc^ as developing curricula 
for a complete grade level? ' 
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Some Thoughts Concerning Evaluation 
and Curriculum Development 

Robert Kar||lus 

I 

The basic ingredients of evalujation are an observation and a 
judgment. In an informal way. therefor^ evaluation is a part of 
everyone's daily professional and home life. Because of its per- 
vasiveness— .all decision-making involves evaluation in some 
way— -the term is applied under many differing condit^ions and to 
many kinds of activities. One can, for instance, speak of the eval- 
uation of individual students* progress in an jeduCational program, 
or one can speak of the progress of a group ©f^students after a 
statistical treatment of data from many individuals. The class- 
room teacher, of course, is concerned with the former.v.%e cur- 
riculum specialist, however, usualjly is more interested in the 
lafter, because he is aiming his products at many students and 
must depend on the classroom teacher to adapt them to the unique 
needs of individuals. Because school administrators and the gen- 
eral public also are largely concerned with data from groups of 
students, one might think that evaluation techniques used by 
them might serve the needs of the curriculum specialist. And 
yet, the standardized tests that are the most widely used evaluation 
device of student achievement are of no value, or possibly of nega- 
tive value, because they are rarely related to relevant curricular 
content, require a great deal of reading, and discourage thought- 
fulnesS. What the scotes do mean I hesitate to define. 

Now that I have limited the general area of my further discus- 
sion, I shall briefly tpouch on what is probably the most contro- 
versial aspect of evajuation: the value system within which the 
judgment is made. One approach is to identify the educational 
objectives, perhaps in behavioral terms, and then to use students' 
average progress toward the achievement of these objectives as 
the yardstick in retaining or revising an activity, pursuing teacher 
education with certain emphases, and/or taking other indicated 
steps. I consider this procedure too limited, because a teaching 
program has sb many cognitive and affective aspects that a com- 
p , plete list of objectives can never be constructed. Still, some ob- 
jectives m^y/ be appropriate^ and their attainment can give a 
partial measure of an activity's effectiveness. 

A second approach to defining the value system is through ex- 
1 tensive discussion and collaboration among the members of the 
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development team, until an implicit operating agreement is 
reached. Decker Walker has called the result of this process a 
'platforrti*. It is never stated explicitly, but rather represents an 
* intuitive sharing of values. Even though a platform can encompass 
iihany more aspects of a teaching program than can a list of objec- 
tives, it cannot readily be communicated to oulsiders and it' is 
likely to have some residual ambiguities even for the insiders. 
Nevertheless, it would appear to complement the objectives ap- 
proach and I would recommend a combination of both. 

Just what role objectives arid platform would play should de- 
' pend on the 'course being developed. If it is ^'to have certain com- 
mon outcomes for all students, then these would lead to the list 
of objectives. At the same time the development team's 'platform* 
would provide for decision-making in areas outside the objectives. 
My personal preference is to minimize the common basic outcomes 
and therefore the list of objectives, and to maximize the freedom 
^ for individuals to develop and pursue their own objectives. 

With the value system determined explicitly, implicitly, or in a 
combined way, the evaluator can take the next step. According to 
Michael Scriven, he has to decide on the function of the evaluation 
in relation to the development process. If the results of evaluation 
are primarily used to improve the course while it is under construc- 
tion, we are dealing with 'formative' evaluation. It is then often 
more important to identify student difficulties and track down 
their origin, than if is to measure average achievement. After all, 
knowing that there are difficulties— and they never go away — is not 
useful to the developer unless he has some clues as to how to cope 
with them. Here the usual testing approach is every limited in 
value. Rather, interviews of students, conversations with teachers, 
and observations in the classroom are likely to be much more in- 
formative! Especially to be considered is the likelihood that part 
of the platform — perhaps mathematical concepts, perhaps critical 
thinking — Has not been understood by either teachers or students,* 
so that only members of the development team can really identify 
successes or failures. I would urge that all members of the devel- 
opment team contribute to formative evaluation both by teaching 
their own activities and by observing teaching by their colleagues 
as wbU as regular teachers. 

Scriyen contrasts forjnative evaluation with *summative' evalua- 
tion, a process that assesses the overall impact and value of a new 
course after it has been completed, with no immediate prospect 
that the results be used to revise the program. This seems like a 




very ambitious task;to me. For one thing, it really calls ifor defining' 
values outside those selected by the developers, but including all 
or some of them, and this reopehs the first task of value setting. 
To sidestep this problem, it has been suggested that summative 
evaluation be merely a fact-finding activity, to be interpreted by 
everyone according to hij^ own values, or that it be *goalfree' {a 
term of Scriven's) in that the ©valuator applies his own value 
system rather than that of the developers. 

Commenting on thej usual ^^experimental design* involving an 
^ experimental and control group, with pre- and post-tests, Malcolm 
,Parlett has likened it to the testing procedure use4 in medicine 
|and agriculture, when a new drug or pesticide has to be evaluated. 
^He calls it the 'agriQijjltural paradigm*, and considers it to have 
-Very limited value v^ken applied in educational situations with 
their vastly greater range of variables and the virtually impossi- 
bility of controlling or even being aware of all relevant ones. He 
therefore recommends illuminative evaluation*, a more clinical 
procedure in which many aspects of the experimental program are 
pra]t>ed in depth by means of observations, interviews, as well as 
. wriii^ten tests and documents. 

Otie matter closely related to the typi^^ information gathered 
|for evaluative purposes is whether the course g^als are short- 
Qrm or long-term influences. Most skill development, such as 
:yping or shorthand, can be viewed as? a short-term -objective, with 
I certain expected accomplishment at the end of the course. If 
Ihe student has a real need for the skills and therefore applies 
Ihem frequently thereafter, he is likely to improve in efficiency; 

J'f he does not use the skill, he will forget it and may have to re- 
earn it at a later time. Many parts of a general education, such 
i^s comprises most of the schooling for pre-coUege students, are 
not closelV related to their current needs and therefore are not 
likely to lead to spontaneous actiyity that maintains, much less 
deepens, the knowledge and understandings that are to be ac- 
quired. The learning outcomes immediately following the conclu- 
sion of a particular course may therefore bp less important than 
the long-term consequences for the individual five or ten years 
l^ter.' Illuminative evaluation is geared to identify both short-^ 
tbrm outcomes and potential long-term influences, though the lack 
of educational theory makes it impossible to extrapolate teliably 
into the future. 

Another way of looking at the long-term/short-term dichotomy 
is to consider evaluation of the educational process versus eval- 
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uation of the short-term educational outcomes. I believe that the 
teacher's attitude toward thjB students, the-'students' opportunities 
to express their own ideas, requirements for intellectual con- 
formity rather than the encouragement of individual opinions, 
and other aspects of the education process have important long- 
term consequences. This is an educational hypothesis that leads 
me to place' more faitR in illuminative evaluation than in the 
agricultural paradigm. How do you feel on this matter? The fact 
that studies'lik§ the Coleman Report have not succeeded in iden- 
tifying any school-related factors that substantially influence the 
Impact of education, only makes me conclude that they have not 
asked the right questions. 

I shall now add to these ''dichotomies^by comparing *public' and 
*private* evaluation. Public evaluation is an activity ^hose results 
are to be used by a professional group of concerneyd individuals 
and must therefore be communicated, usually through journal 
publication, to anyone' who cares* to acquaint himself with the 
findings. . Private evaluation is intended for the use of the eval- 
uator and his close professional associates. Its results are there- 
fore communicated informally, with only implicit - references to 
the shared values of the working group. Private evaluation is thus 
closely similar to the everyday evaluation I mentioned at the 
beginning of these comments, and it is, in my opinion, the vital 
component of successful curriculum development. ^I shall go fur- 
ther to claim that public evaluation, when viewed as an essential 
part of curriculum development effort, is likely to be counter- 
productive for three reasons: (1) it consumes valuable resources; 
(2) it highlights decisions that can be documented easily, regard- 
less of their importance or merit; (3) it delays decisions until more 
than the minimum necessary evidence is assembled. In other 
word^, I believe that all real decisions are based on private eval- 
uation, and that public evaluation is an after-the-fact rationaliza- 
tion. , ' 

In conclusion, I should like to promote a couple of ideas that I 
have been developing durkig the last few years. One involves 
asking students not only to answer certain test questions, but also 
to explain or justify their answers. The original question might be 
a multiple, choice item, a mathematical problem, a scientific pre- 
diction, or any other ordinary test item. The novel aspect is that 
the student's explanation or justification gives the evaluator in- 
sight into the student's understanding if the answer is correct, or 
into his misconception if it is incprrect. Of course, writing and 
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reading the additional material are time consuming, so that th^^ 
number of test items has to be reduced when this technique is. 
used. Another advantage of this kind of questron, however, is that 
the students come to realize that answers have reasons. 

The second idea is to pose some questions that do not uniquely 
define a problem situation. The student is asked 'first to evaluate 
the question and supply any information or conditions that may be 
needed to make the problem unique, and then to answer the ques- 
tion itself. Here also, the time needed for scoring is increased, and 
the scoring itself becomes more complex. Note that both of these 
ideas address themselves to' the higher categories in Bloom's 
taxonomy. 
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Value Systems, Approaches and Accountability: 
A Reaction to Professor Karplus 

H. Russell Cort. Jr. 

My task is to react to Professor Karplus' thoughts and sugges- 
tions abx)ut evaluation in the" service, or disservicei of curricu- 
lum development. By agreement, I will try to be provocative. It 
was such a wide ranging exposition that perhaps the first thing for 
me to do is to summarize what seem to be the main topics, and 
then the main implications. The following seem to be the main 
points made: c< 

1. Evaluation, which involves an observation and a judg- 
ment, pervades all decision-making; ' 

2. Standardized achievement tests are of no value (or of nega- 
tive value) to curriculum specialists, since they are not directly 
related to specific curriculums; 

3. Evaluation, even goil free evaluation, involves the applica- 
tion of a value system, and therein lies much contention. 
Nevertheless there are different ways of defining the value 
system-— implicitly, explicitly, or some combination. 

4. While the usual evaluation models are experimental 
(psYchometric/agricultural paradigm) it might be more 
productive to pursue illuminative evaluation, using more 
clinical methods. 

5. One can distinguish short-term or long-term objectives and 
effects, and also public anjd private evalution. Public evalua- 
tion is done for a concerned group other than the developers, 
teachers or whomever. Private evaluation, which is more like 
everyday evaluation, is informal and internal to a project. 

6. Finally, there is something to be gained from asking students 
to explain their multiple choice answers, and one should 
pose somewhat ambiguous questioi\s and ask students to 
evaluate them before answering them. 

The thrust of all this seems torme to be that curriculum de- 
velopment projects should have their own internal evaluation 
processes; they should not be encumbered with outside (or by 
^ public) evaluation; and they should not be restricted to an experi- 

mental model routinely pumping out pre and post standardized 
test scores. If I have misrepresented the thrust of the paper, it 
may be that I am not privy to the platform from whence it was 
launched. I did have some difficulty getting a clear sense of where 
we were headed.^ 
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In considering these points from a different perspective — that 
is. as a researcher and e^^aluator rather than a curriculum special- 
ist— I find myself in essential, unruffled agreement with .some 
points, confused about the purpose of some points, and disturbed 
about the straw man quality of others. 

Taking my own valtie system in hand, I should like to comment 
on several aspects of Kprplus* propositions. 

1. The problem'of values. 

2. The available tools for evaluation. 

3. Finally, — accountability. 
First. I quite agree that evaluation involves application or 

tacit involvement of a value system, and that it involves obser- 
vations and judgments. Some years ago I found myself thinking 
that the issue of evaluation is not whether it is done or not. The 
issue is how, by what rules of evidence, and according to whose 
. criteria. Values of course are always present and they affect what 
one observes, how one interprets, how one weighs factors in ar- 
riving at decisions. Precisely for this reason, I think, it is appro- 
priate to have^an outside person, especially in formative formula- 
tive evaluation, not inducted into the platform or sub-culture 
periodically review, audit; etc., to upset sets. 

In some respects, evaluation can be viewed as a form of applied 
^ epistemology. The basic problem is to determine how you know 
whether something is so or not. One interesting application of this 
arises in the case of criterion-referenced tests in which the problem 
of deciding! on a pass-fail criterion is really the problem of how 
much or what kind of evidence do you require to decide that a stu- 
dent has mastered something. There are at least two, and possibly 
three, general criteria of mastery: 

1. Immediate retention,' as measured by an immediate per- 
formance defined as successful; 

2. Long-term retention (how long term is long term?); 

3. Transfer or generalization. 
The first is frequently a criterion in a learning experimei^Lt. But 

the curriculum designer may, I think, be at least as interested, if 
not more so, in the latter two, given the first. 

The point in the present context is that evaluation is in no small 
» part a struggle to know whether something, is so. Has this student 
mastered this concept? Has this material facilitated that learning? 
Is this teacher using this unit or material as intended? In this sense, 
evaluation is a process beset with the hazards, pitfalls and economic 
restrictions that beset any inquiry. The choices confronting both 
curriculum developer and ev^luator (or curriculum developer as 
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evaluator) are not, I think, first of all results of diffferences in value 
systems. They are the results, purely and simply, of limited re- 
sources. My own experience in program of project evaluation is 
that the first and foremost problem is deciding {hopefully with the 
project staff if we are doing evaluation for a project) what ques- 
tions are important to afiswer within the limits ofjime and resources. 
^ This is, of course, a values problem but not necessarily a problem 
of value conflict. I am tempted to hypothesize that the closer you 
get to the ,implementer (e.g., the teacher) the more questions the 
user would like to have answered. The value problem becomes more 
evident as you get^ down to considering what ^is worth knowing 
(evaluating) and how much is it worth. 

The curriculum designer and, indeed, the teacher, face exactly 
the sameXdecision problem (viz. deciding what is worth how much 
effort.) THe teacher, for example, must trade-off amount of mastery 
desired against interest or motivation. If it turns out, according to 
somfe recent data,* that one level of mastery .may enhance reten- 
tion,\but a slightly reduced level may enhance continuing interest 
in the subject. I would hope that evaluators would help clarify such 
choices, as well as choices of evaluation priorities, rather than to 
impose a set of priorities arbitrarily. 

I don't want to belabor the values issues unduly here. However, 
two further points seem in order. I think the most practical problem 
evolving out of the values issues is not whether to use behavioral 
objectives, or to develop a metalanguage and sub-culture among 
the development team. Certainly from the evaluator's point of view 
the practical problem (especially in formative evaluation) is to 
determine users information needs. I have used from time to time 
, the concept of an information users needs assessment as a device for 
focussing on the problem of credibility, acceptability and utility 
of evaluation information. An evaluation person, especially in a 
formative mode, needs to determine, obviously, not only who his 
audience is (and it may be a number of people in a number of posi- 
tion and agpncies.) He also wants to know what are their various 
priorities with respect to questions and information, and what cri- 
teria of success and effectiveness do they have. Professor Karplus 
suggests that all real decisions are based on private evaluation (and 
that public evaluation is an after the fact rationalization.) 

*Block, James H. Student Evaluation: Toward the setting of mastery performance 
standards. Paper presented at the annual meeting of the AERA, Chicago, 111., 
April 4. 1972 (ED 065-605). 
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I think the'public/private dichotomy is somewhat a straw man 
problem as used here. Private evaluation could be as rigoraus in a 
scientific sense as public evaluation presumably is, and real deci- 
sions could be based explicitly on the results of such an evaluation.* 
The point is that one can be aware of disparities in values between 
evaluator and practitioner and take explicit steps to explicate underr- 
lying assumptions and differences in values. One of the useful func- 
tions of evaluation may indeed be to reveal and clarify underlying 
values which have constrained'the curriculum under development. 

The second point I wanted to make about values, before turning 
to another issue, is that the developer of a curriculum may have a 
set of shared values about the materials developed, and indeed 
may' be one of a set of judges about success or failure of it, in 
Karplus* terms. However, once the curriculum enters tjie public 
domain, it becomes subject to use and judgment according to value 
systems, beyond the developers cantrol. Perhaps a useful function of 
formative evaluation is \o try to determine and bring to'bear as 
wide a range of value$ as possible so that designers can decide what 
they want to do about some anticipated reactions. 

I now want to turn to the image of evalua^tion that seems to me 
to come through in Professor Karplus* paper. It (evaluation) seems 
simplistic*, trivial and possibly somewhat of a rip off on the one 
hand; 'and as natural, necessary and pervasive as metabolism on the 
other. The image of formal, public, or summative evaluation as 
ambitious, ponderous, irrelevant, superficial and devoted to the 
dogged administration of standardized tests is, perhaps, easy to 
support with some recent well chosen examples. I have my own 
collection of horror stories. The real issue I think, is the question of 
what conceptual and analytic tools are most appropriate to what 
kinds and stages of curriculum development, dissemination, adop- 
tion, implementation and modification or revision? Karplus has 
mentioned formative and summative evaluation, as well as long- 
term/short-term; public/private; experimental versus clinical or 
illuminative. I would like to call attention to the proposition that 
the field of evaluation seems to suffer not only from a dearth of 
good examples, but also, paradoxically, from a plethora of models. 
There does seem to be a shortage of theory and practice in teaching, 
using and adopting various models. 

/ 

*Public evaluation, as I understand its meaning here, need not necessarily be de- 
structive or counterproductive. By the sameyoken. private evaluation could be 
misleading and negative in its consequenpe^ 
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Here, for example, is a little book that came out about a year 
ago by Sara Steele'. It is called: Contemporary Approaches to^co- 
gram Evaluation: Implications for Evaluating, Programs fom)is- 
advantaged Adults.* 

What Steele has atuempted to do is to classify a variety of pro- 
gram evaluation approaches and to give a brief description of each. 
Nearly 60 models or approaches were included. 

Major categories identified are six in number: 

1. Evaluation as Input Into Decision Making 

2. Evaluation of Program Parts 

3. Evaluation— Kinds of Data; Types of Activities 

4. Evaluation Processes 

5. Results— Attainment of Objectives 

6. Results— Evaluation of Outcomes and Effects. 

Steele also attempts to classify various approaches according 
to different frameworks, such as frameworks for examining the 
impact and larger results of programs; frameworks for examining 
the results of instruction; frameworks for viewing the program 
through the eyes of the participant, etc. 

Finally Steele attempts an interesting cataloguing. She attempts 
to match evaluation approaches to problems and needs. She con- 
siders three types of problem: 

1. programming 

2. program management 

3. evaluation. 

She then lists a large number of problems in, say, programming 
and suggests for each one or more evaluation approaches that 
might be helpful. 

I am not neciBSsarily endorsing Steele's effort here. There are 
other similar efforts of even more recent vintage that support the 
same general p^-oposition. (e.g., a number of authors in Gary Borich's 
book: Evaluating Educational Programs and Products.)! My point 
in bringing it up is this. There are available a large variety of con- 
ceptualizations, techniques and approaches. One may regard this 
as evidence of a state ^f blooming, buzzing confusion. J Or, one may 
hypothesize ^at a variety of evaluation situations, needs and aims 

*Educational Resources Division Capitol Publications, Inc.. Suite G-12, 2430 Penn- 
sylvania Ave,, N,W., Washington, D.C. 20037, 1973. 

•fBorich. Gary D> (Ed.), Evaluating Educational I^rograms and Products. Englewood 
Cliffs, N.J.: Educational Technology Publications. 1974. 

tXo borrow William James* classic depiction of the jjerceptual world of the infant,* 
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have begun to give rise to a variety of methods and models from 
which one can pick and choose judiciously. 

I think the same general point applies to other tools of the trade. 
There are increasingly abundant instruments, procedural check- 
lists,' methods and materials. The Social Science Educational Con- 
sortium has a detailed model for analyzing curriculum materials. 
Scriven (in Borich) has recently published a suggested set of 
standards for evaluating educational products or programs. The di- 
mensions^ include:* 

Student Need 
' The Market 
Performance Data Available 
(A series of dimensions here) 
Critical Comparisons 
Long Term 
Side Effects 
Process 

Statistical significance 

Educational significance 
Cost-effectiveness 
Extended Support 

It sounds as though I am suggesting that evaluation, as an oper- 
ation and a process, now has sufficient constructs, models and 
methods to proceed in straightforward, effortless, or automatic 
fashion to support curriculum development and implementation 
effectively at any siate and at no great f ost. 

Not necessarily so. Evaluation still has basic design problems to 
confront analogous to those of curriculum design. It seems that 
curriculum design (as discussed at this conference) ^wfestle^^Jwtfh 
the perennial questions of: 

What to teach? 

When to teach? 

How to teach? 

Similarly, evaluation perforce addresses the question of:t 

i 

*Scriven, Michael, Standards for the Evaluation of Educational Programs and In 
Borich, Gary D. (Ed.), Evaluating Educational Programs and Products. Engle- 
wood Cliffs, N.J.: Educational Technology Publications, 1974, ^p. 5-24. 

"fC. F. Webb, Wilse B., Measurement of learning in extensive training programs. 
I. DuBois, Philip H., and Mayo G. Douglas, Research Strategies for Evaluating 
Training. AERA Monograph Series on Curriculum Evaluation, No. A Chicago: 
Rand McNally, 1970, pp. 55-65. Webb focussed on what, how and when to 
measure as basic problems. 




What to observe or measure? 
When to observe? 
How to observe? 

A final point. The agenda mentioned acpountability as part of our 
* topic. I have found myself pondering the question of accountability 
in curriculum development, to whonl is the curriculum developer 
accountable, and for what? ^ 

Part of the problem here comes about from the concept of ac- 
countability. A perusal of the literature does not induce confidence 
that there is i^jniversal, mutually shared platform here. ' 

In ariy case, I suggest that one form of accountability in curricu- 
lum development was suggested in Jim Robinson's paper. Obtain- 
ing and using information about students needs and abilities for 
different age levels and backgrounds would be one push toward 
accountability. Similarly, determining teachers' needs and abili- 
ties is another. Further explication of the performance character- 
istics of materials is yet a third. 

A basic problem,* of course is cost and time. But there is one 
other problem that is even more perplexing: the lack of a market 
for such information or data. 

The gatekeepers mentioned (givers to teachers, for instance) are 
truly apt to make real decisions, in Karplus' terms, on the basis of 
private criteria and evaluations. There is a substantial job of edu- 
' cation needed here. 
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Pragmatism — The Key to Changing Schools 
in the Seventies 

Ernest Burkman 



It must have been great to run a science curriculum project in the 
early sixties when innovation was everybody's goal>when science 
could do no wrong, and when ^dollars flowed freely. Under those 
conditions, the curriculum developer who could build a better 
mousetrap, any mousetrap, could confidently expect the world 
to beat a path to his door. 

But today, people in our business work in a far different world. 
Now, many future-shocked Americans want to slacken the pace of 
change, and most have become economic conservatives. Further- 
more, science now ranks^Iar behind the three Rs on most lists of 
educational priorities. To be a successful change agent under these 
conditions one must not only build a better mousetrap, but must 
also beat a path to the world's door. I will try here to spell out my 
conception of how to do this. 

For brevity, I have organized my remarks into seven propositions 
as to factors that influence the adoption of curriculum materials. 
Each proposition is accompanied by a rationale and some implica- 
tions for curriculum developers. I hope that this form of presenta- 
tion will sharpen some of the issues and therefore promote dis- 
cussion. 

PROPOSITION 1— Those likely to be affected by a curriculum de- 
velopment effort must participate in its planning and execution. 
Rationale — Whether we like to admit it or not, there is a natural 
mistrust among elements of the science education community 
(i.e., scientists, science teachers, administrators). Furthermore, 
being human, educators are not immune to vanity. Involving 
many people of many types not only insures a curriculum project 
of important input, but is also the surest way to convert doubters 
into supporters. 

Implication — Development teams should be large and diverse and 
include scientists, supervisors, teachers, teacher educators, and 
general administrators from all parts of the country. 

PROPOSITION 2— Field testing is an act of dissemination as^A^ell 
as arway to collect feedback. 

^tionaJe— Most teachers and school districts assume that their 
problems are totally unique. Seeing curriculum materials being 
successfully used in local or nearby classrooms is the strongest 
motivation for adoption. 





ImpJication— Field testing should involve large numbers of stu- 
dents distributed nationally according to population density. 

PROPOSITION 3— Curriculum projects must specifically design 
their final product to be sold at a profit in a highly competitive mar- 
ket. 

RationaJe— To achieve wide distribution, most projects must turn, 
to a commercial publisher. The only way to attract and maintain 
the cooperation of a first-linQ publisher is to insure during\deveJ- 
opment that the final package makes setise commercially ak well 
as pedagogically. x 
ImpJication— During deveJopment, projects must accept whfft^^ 
ever constraints are required to insure that; (1) the commercial ^ 
selling price of the final package will be competitive, (2) the pub- 
lisher will have the exclusive sales rights to enough material 
with enough sales potential to generate a profit, and (3) the form 
of the final package does not preclude adoption by large numbers 
of prospective users. 

PROPOSITION 4 — Curriculum materials must be designed such 
that their implementation does not depend upon extensive modi- 
fication of existing school facilities or large expenditures for new 
equipment. 

RationaJe— The population trend means that future science in- 
struction will be done almost entirely in existing buildings and 
classrooms. Furthermore, school science budgets are in a period 
of continuing decline. Under these conditions schools will reject 
any program that calls for large investments in plant or equipment. 
JnipJication — Projects should exclude learning activities which 
require large expenditures for implementation regardless of 
their pedagogical advantages. 

PROPOSITION 5 — The content of ne^v curriculum materials 
must be consistent with existing course patterns. 
RationaJe— Strong arguments can be made as to the validity of 
what is and is not included in the science curriculum and the way 
science courses are presently structured. Biit teacher training and 
certification, classroom design and equipment, graduation re- 
quirements, ^and other vital matters have' been geared to what 
exists and thus serve as powerful deterrents to change. In the face 
of these biases, adoption of totally new content thrusts is most 
difficult and unlikely. 

ImpJication— Projects seeking to infuse new content into the 
curriculum should do so by adding new parts to old courzes rather 
than by demanding or assuming wholesale course deletions and 
additions. 
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PROPOSITION 6— New curriculum materials and approaches 
must be useable by present teachers. 

Rationale^Much' evidence suggests that over the next several 
years, relatively few new teachers will enter the profession. This 
means that science curriculum developers must count on people 
already in the classroom to implement their products rather than 
hope for better prepared new teachers. 

Implication — Although you can teach old dogs scrnie new tricks, 
you can't make a bird dog out of a Chichuahua. Projects must 
temper their zeal to introduce new content and instructional 
procedures to match what can realistically be expected of teachers 
whose training and experience is in different directions. Normally 
this means the project must fprego some of its aspirations. 

PROPOSITION 7— Curriculum projects must release their final 
product$ at a time of high interest in the tyjJe of innovation being 
promoted. 

Rationale — Social conditions, more than any other factor, deter- 
mine school curriculum practices. Curriculum materials thait 
promote directions that are counter to existing social trends are 
not likely to have much impact. Good materials can stimulate or 
institutionalize directions that are already underway, but rarely 
do they initiate new movements. 

Implication— Projects that are totally out of tune with social con- 
ditions should not be started, and those that are in tune should be 
completed with dispatch to avoid losing the 'teachable moment.' 

I realize that some curriculum developers will be unhappy with^ 
my propositions. They will say something to the effect that 
Michelangelo would never have created David if he had focused 
On making his creations fit social conditions, on meeting dead- 
lines, and on the price of marble. 

My response is that developers wanting to be in the David pro- 
ducing business should ignore the nuts and bolts matters that I 
have mentioned and concentrate on producing the world's best 
science curriculum. I hasten to point out, however, that most of 
the world's best science curricula that have been produced to date 
are found on library shelves, not in classrooms. 



Reaction to ''Pragmatism— The Key to Changing 
Schools in the Seventies" 

Emil Joseph Piel 

Dr. Burkman has indicated a number of problems which face us 
in the implementation of new curricula in the seventies and 
eighties. While I agree with the essentials of the statement of the 
problems, I find myself in strong disagreement with many of the 
propositions and implications indicated as ways to ^olve them. 
/ There is no question that educational institutions are resistant 
to change. The question is whether we should accept this resistance 
as essentially insurmountable as seems to be implied by Dr. Bi^rk- 
man, and concentrate on short term success, or-should we work to 
develop and implement curricula which will bring' about those 
changes which are most desirable, or should the National Science 
Foundation support a combination of short term and long term 
prograrhis? 

A logical way in which to react to Dr* Burkman's remarks will be 
to respond to the various propositions, rationales, and implica- 
tions in the order in which they were presented. I will spend more 
time on those with which I disagree most strongly. 

If Proposition 1 is valid, that those likely to be affected by a 
curriculum development must pai'ticipate in its planning and exe- 
cution, either NSF or USOE or some national group must support 
the inclusion of the sixty million or so students in schools as they 
participate in the planning and execution of national curricula or 
there should be no nationally developed curricula. It is the stu- 
dents who should be the ones most likely to be affected by a curfic^i- 
lum development effort. 

This is the group for whom we claim to be developing the courses 
and materials. In actual pracfice however, it is often the scientists, 
science teachers, and administrators who are affected and the 
final effect never gets tolhs' students. 

The implication of thrs proposition did not include even^the men- 
tion of tokei;i student participation in the program developnient 
and this is regrettable. 
f Student participation aside, another question arises on wide- 

spread inclusion- of teachers, administrators, etc. and that is the 
question of timing. With the present economic situation, it is not 
^ feasible to include large numbers of people in curriculum devel- 

opment ati the very outset, or planning phase, and yet this is when 
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the philosophy, objectives, and approach are usually set. (With 
25,000 secondary schools in the U.S. a group of 250 secondary 
school people would be only a 1% representation.) 

And so while ! agree with the proposition, if it includes students 
and eliminates the word must. I have strong reservations as to the 
rationale and implications'^s stated by Dr. Burkman and .the eco- 
nomic feasibility if carried to any reasonable conclusion. 

Once the philosophy, objectives and approach are stated by the 
planning group, the great masses of teachers and students either 
accept them, reject them or modify them for their own use. It is 
unrealistic to believe that more than a handful of people are going 
to be involved in the actual planning. ^ ' o 

Proposition 2 is straightforward and logical. Field testing is in- 
deed an act of dissemination as well as a way to collect feedback. 
My only concern here is the realism of field testing with large num- 
bers of students. The larger thegnumbers of students involved, the 
greater the Variety of observers (or filters) through wljich .the 
feedback must be returned and the less valid such feedback be- 
comes. If on the other hand the feedback is to be ignored anyway, 
which I have seen happen, then the dissemination value of using 
large numbers of students is the overriding consideration. It 
would geem that a small number of feedback centers which were 
chosen for their resistance t8 the Hawthorne Effect might be a 
more feasible way to obtain valid feedback while including the 
large numbers in a second phase for the sake of developing a firm 
dissemination base. Wide dissemination is a result of having many 
enthusiastic satisfied customers selling the materials. These are 
not the kinds of people who provide the most critical feedback. 

Proposition 3 — Curriculum projects must specifically design their 
final product tt) be sold at a profit in a highly competitive market. 

This is a proposition up with which I will not put. I still believe that 
curriculum projects must specifically design their final products 
to meet the edillcational needs o^ the community for which they are 
being designed. 'Ais is )he major criterion. One of the constraints 
is that it must be sold at a profit in a highly competitive market. 
This statement is not ^si a matter of semantics or rhetoric but of 
philosophy. I can still recall being told by a publisher for whom I 
was writing test questions that while my questions were creative 
measures of the cognitive learning of the students they were not 
geared to specific pagfes of the text and therefore would not help 
to sell books. Other than discussions on contract termination, that 
was the last conversation I had viiih that publisher. 
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The implication which I s6e for this proposition is that NSF should"^ 
close up its Curriculum Development SJiop and turn this chore 
over to the publishers who know what will sell at a profit in a highly, 
competitive market and we can go back to physics books w;ith four 
color transparent overlays of the steam shovel. 

While I object to the proposition, I can agree with the implication 
statements with reservations. They are that projects must accept 
some but not whatever constraints to insure that the commercial 
selling price will be competitive, pujjlisher will have exclusive* 
sales rights, and that the final package will have reasonable num- 
bers of sales. The development of materials for the very bright 
potential scientists/engineers or for the educationally handicapped 
might be seriou.qly hampered by adhering to this proposition and „ 
the stated imphcations. For example/ computer materials would 
still not be developed if this proposition had been followed in the 
1960's. 0 , ' 

Proposition 4— While I agree in principle with the proposition that 
most projects should retrain from developing curricula which re- 
quire large expenditures for new equipment, there would be httle 
progress in the entire area of computers in the curriculum if this 
had been followed by all curriculum projects in the past. For ex- 
ample, at the present time, all high schools in Rhode Island have 
access to cofnputers for educational purposes, as well as 60% of 
those on Long Island, at least half in Oregon aim Delaware, and 
10t)% in Raleigh, N.C., Philadelphia and Washington D.C., to name 
but a few which come immediately to mind. 

None of these vW)uld be this far along if it were not for USOE and 
*NSF support^of projects which did require large expenditures for 
new equipment. 

It is true that the computer manufacturing companies have. also 
pushed for this acceptance. It is also true that the chaotic sif^- 
tion regarding educational computing facilities^ on college cam- 
puses is due to the fact that the introduction of computers to col- 
leges* was through the manufacturers rather than through curricu- 
lum reform. ^ 

To state that schools wiU^ject any program that Calls for large 
investments in plant or equipment is to accept a return to the text- 
took and chalkboard and to forget any experimentation with new 
approaches to teaching through the use of educational technology ^ 
such as computers, television, tape recorders, etc. 

To exclude learning activities . . . regardless of their pedagogical 
advantages is to develop nothing new if it costs money. When a 
school administrator says *'I like \our progranr? but It costs too 
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much" what he really means is **I don't like your program enough 
to spend the money on it."-^ 

Prices on equipment are reduced when large numbers of people 
are willing to buy it. For example dufing the decade from 1964- 
1974 the prices of color T.V/s, radio's, calculators, etc. have gone 
down primarily because (he demand is great enough to warrant 
mass production. An oscilloscope with a fraction of the compo- 
nents and circuits of a T.V. costs about five times as much for a 
comparable size screen. 

Proposition 5 — '*The content of new curriculum materials must 
be consistent with existing course patterns." This proposition like 
many of the preceding ones accepts the status quo as correct and 
irrefutable. If we really believed that none of us would be here 
today. It is true that the adoption of neW content thrusts at 
changing existing course patterns (just to see^what happens) than 
to support only programs which result in" little more than a tpxt 
revision, or a new unit of study here or there to be fed into present 
existing dull Courses. ^ 

A quick and flirty survey of two schools in the immediate vicinity 
of my office indicates the following additions to the curriculum 
SINCE 1970. 



Oceanography 
Expositor;^ Writing 
Social Psychology 
Criminology 

Power Mechanics 3 (Building 

Racing Car) 
Electronics 3 

Cooperative Industrial Education 
World/Urban Geography 
Eastern Thinking in Western 

Literature 
Existentialism & Alienation in 

Modern Literature 
Science Fiction ^ 
Techniques of Persuasion i\i Fiction 

'and the Mass Media 
Social Problems of Today Explored 

through Literature 
Critical Thinking 



The Progressive Era & The Twenties 
You and the Law 
Environmental Science 
Evolution 

Computer Science I. II, III 
Problems in Consumerism 
Tailoring 

Girls Metal Working and 
Auto Maintenance ^ 

The Supreme Court 

Urban American Life 

Experimental Biological Literature 

Environmental Chemistry 

Algebra 11 with Computer 
Programming 

Interior Decoration • ^ 

Ceramics 

Health Careers 



While many of these might be considered as 'mickey mouse' courses 
—to which none of us would subscribe, the point is that schools 
ar^ willing to put in new courses. 

Interestingly, these are school^ which have consistently faced the 
problems of voters turning down budgets during these same five 
years, ^ well as in previous years. 
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This is not to deny the fact that change can come about by adding 
-new parts to old courses and gradually pushing out the old mate- 
rial, but to assume that it is the only way is to put the same restric- 
tions oji educational progress as now exist with college board and 
New York regents examinations. 

Proposition 6— New curriculum materials and approaches must 
be useable by present teachers. 

While I agree with the rationale that relatively few few teachers 
will enter the profession, I cannot acc^t the concept that proj- 
ects must match what 'can realistically De expected of teachers 
whose training and experience ended in 1970^1 would much prefer 
that curriculum change be the impetus behind the re-education of 
these teachers w)io will be with -us for the next two or three 
decades. The implication herfe should really be that Inore money 
must be s^nt in teacher eduction, for the purpose of implement- 
ihg new curricula. V ' 

^^^roposition 7«^Curriculum projects must release their final 
products at a time of high interest in the type of innovation being 
promoted. 

It is good to hear that we are^till inkrested^in promoting inno- 
vation. After listening to propositions 3 through 6 I began to feel 
that we are not expected to do anything new. However, to say that 
we will time the release of final prcMucts at a time of high interest 
is again to assume that our final prpducts will not be leading the 
changes in schools but following ther 

If education in 1980 is totally out M tune with social conditions 
(which I suspect it will be) and we are to agree with propositions 
3-6, which tend to keep us on the narrow track of the status quo, 
then curriculum development will allsoMDe out of step with social 
conditions and therefore, according to t^is statement, should not 
be started. 

The social conditions of the fall of 1974 a^e Inergy crisis, pollution 
problems, economic crisis, political crisis, qrime, food crisis and an 
overriding population problem. « 

rHow many texts on the abpve subjects are being sold in the highly 
competitive market? How do we study these and still be consistent 
with existing course patterns? How many of pie teachers studied 
these problems in thejr preparation? And finally, hjow many 
curriculum projects which follow propositions 3 througii6 6 are in 
tune with these conditions? 

If as Dr. Burkman says in his concluding remarks, most of the 
world's best science curricula are found on library shelves, and not 
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in classrooms then we should concentrate our efforts on getting 
them off the shelves, not on developing second or third rate pro- 
grams just because they will sell, 

" This then is the problem which we as Curriculum developers and 
the' National Science Foundation face. 
Shall we: 

1. Work to develop curriculum programs which will show the 
> way for the next decade? 

2. Work to develop curriculum programs which will not be 
very innovative, but which will sell? 

3. Concentrate our time, effort, and financial resources on 
getting the best science curricula of the past decade off the 
shelves and into the class|'OC)ms? 

or 

as we rfecall from some of the poorly written, tests, of the 
nineteen fifties; 

4. None of the above? 

These are some of the problems with which I suggest we wrestle 
during the remainder of this session. 
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AGENDA 



PES/MIDS Project Directors Meeting 

CURRENT ACTIVITIES AND THE TASK AHEAD 

Airlie House 
September 13-15, 1974 

Friday, September 13 " 

8:30 p.m. Opening Session — Laurence O. Binder, Presiding 

Saturday, September 14 

9:00 a.m. Plenary Session — Jean B. Intermaggio, Presiding 

Topic: The Challenge of Developing an Inter- 
disciplinary Curriculum 
Presenter: Peter B. Dow 
Reactor: James T. Robinson 

10:15 a.m. Small Group Discussions (six) 

11:15 a.m. Reporting Session 

2:00 p.m. Plenary Session — James W. Wilson, Presiding 

Topic: Evaluation-Formative, Summative, 
Accountabilit-y 
Presenter: Robert Karplus 
Reactor: H. Russell Cort, Jr. 

3:15 p.m. Small Group Discussions (six) 
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4:15 p.m. Reporting Session 

8:00 p.m. Group Discussions—Participants* Choice 

Sunday, September 15 

prOO a.m. Plenary Session— Daniel C. Yohe. Presiding 

Topic: Dissemination and Implementation 
Presenter: Ernest Burkman 
Reactor: E. J. Piel 

10:15 a,m. Small Discussion Groups (six) 

11:15 a,m. Reporting Session ' 

1:30 p.m. Small Discussion Groups (six) 

Topic: New Directions 
2:30 p.m. Plenary Session — Raymond J. Hannapel, Presidin 

Panel Discussion — New Directions 
4:00 i^.m. Adjournment 
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PES/MIDS PROJECTS 



PARTICIPANTS 



Robert Angell 

(Sociological Resources for the 

Social Studies)* , 
Department of Sociology 
University of Michigan 
AnR,Arbor, Michigan 48104 

John K. Bare 

Human Behavior Curriculum Project 
Carleton College 
Northfield, Minnesota 55057 

Betty Beck 

Unified Science and Mathematics 

for Elementary Schools 
Education Development Center, Inc. 
55 Chapel Street 
Newton, Massachusetts 02160 



E. G. Begle 

(School Mathematics Study Group)* 
10 Cedar Hall 
Stanford University 
Stanford, California 94305 



•Denotes completed project. 



Max S. Bell 

Explorations into Ways of Improving 
Elementary Mathematics Learning 
Graduate School of Education 
The University of Chicago 
Chicago, Illinois 60637 

Truman A. Botts 

National Advisory Survey of School- 
Level Mathematical Education 

Conference Board of the 
Mathematical Sciences 

2100 Pennsylvania Avenue, N,W. 

Washington,J).C. 20037 

Ernest Burkman 
Individualized Science 
Instructional System 
The Florida State University 
415 North Monroe Street 
Tallahassee, Florida 32301 

Robert Chesley 

National Institute of Education 
Washington, D.C. 20208 

Jerome L. Ciesla 
Individualized Science 
Instructional System 
The Florida State University 
Tallahassee, Florida 32301 



ERIC 



71 



H. Russeil Cort, Jr, 
A Longitudinal Comparative Study 

of the Effects and Impacts of M ACOS 
Antioch College 
2139 Wisconsin' Avenue. N.W. 
Washington, D.C, 20007 

<}ames E. Davis 

Social Science Education Consortium 
855 Broadway 
Boulder, Colorado 80302 

Robert B. Davis 

Analysis of Operational School 

Mathematics Curricula 
University of Illinois 
1210 West Springfield 
Urbana. Illinois 61801 

George O. Dawson 
Intermediate Science 
Curriculum Study 
The Florida State University 
415 North Monroe Sltreet 
Tallahassee. Florida 32301 

E. Thomas Denmark, Jr. 
Project for the Mathematical 

Development of Children 
The Florida State University 
Tallahassee, Florida 32306 

Peter B. Dow 

Education Development Center. Inc. 
15 Mifflin Place 

Cambridge, Massachusetts 02138 
Linda Dubaldi 

Intermediate Science Curriculum 
' Study 

The Florida State University 
415 North Monroe Street 
Tallahassee, Florida 32301 

James Fey 

National Advisory Survey of School- 
Level Mathematical Education 

Conference Board of the 
Mathematical Sciencejs 

834 Joseph Henry Building 

2100 Pennsylvania Avenue, N.W. 

Washington, D.C. 20037 



^Denotes completed project. 



E. Glenadine Gibb 
(Improvement Project in Mathe- 
matics for Selected Groups)* 
Sutton Hall 412 ^ 
University of Texas 
Austin, Texas 78712 

Anita Gil . ^ 

Exploring Human Nature 
Education Development Center, Inc. 
15 Mifflin Place 

Cambridge. Massachusetts 02138 

Herbert Ginsburg 
Analysis of Operational School 

Mathematics Curricula 
Center for Research in Education 
Cornell University ^ '-^^ 
Ithaca, New York 14850 

Janet Hanley 

Education Development Center, Inc. 
15 Mifflin Place 

Cambridge, Massachusetts 021^8 

Nicholas Helburn 
(Geography in an Urban Age)* 
Department of Geography 
University of Colorado 
Boulder, Colorado 80302 

Alan R. Hoffer 

Topical Resource Books for Middle 

School Mathematics Teachers 
University of Oregon 
Eugene, Oregon 97403 

Ruth I. Hoffqian 
Mathematics Laboratory 
University of Denver 
Denver, Colorado 80210 

Leonard Hughes 
Biomedical Interdisciplinary 

Curriculum Project 
1947 Center Street 
Berkeley, California 94704 

Paul Hurd 
School of Education 
Stanford University 
Stanford, California 94305 
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Robert Karplus 

Science Curriculum Improvement 
Study 

Lawrence Hall of Science 
University of California 
Berkeley, California 94720 

Edward ]. Kormondy 

Four Motion Pictures in Social 

Biology 
Evergreen State College 
Olympia, Washington 98505 

Nathaniel J. Kutzman 
Science Teaching Assistance Center 
Montana State University 
^ Bozeman, Montana 59715 

Watson M. Laetdch 

Outdoor Biology Instructional 

Strategies 
Lawrence Hall of Science 
University of dalif ornia 
Berkeley, California 94720 

]ohn LeBlanc 

Problem Solving Strategies and 
Applications of Mathematics 

Mathematics Education Development 
Center 

Indiana University 

Bloomington, Indiana 47401 

Tom Liao 

{The Man-Made World)* 
Department of Engineering 
State University of New York 
Stony Brook, New York 11790, 

William G. Lister 
UICSM-Ninth Grade Course 
60 Mill Lane 

Huntington, New York 11743 

Arthur H. Livermore 
American Association for the 

Advancement of Science 
1776 Massachusetts Avenue, N.W. 
Washington, D.C. 20036 



*Denote8 completed project. 



]. David Lockard 
Science Teaching Center 
University of Maryland 
' College Park, Maryland 20742 

Earle L. Lomon 

Unified Science and Mathematics 

for Elementary Schools 
Education Development Center, Inc. 
55 Chapel Street 
Newton, Massachusetts 02160 

Phillip Makurat 

Junior High School Teachers' Center 
Department of Secondary Education 

and Mathematics 
University of Wisconsin 
WhiJ^water, Wisconsin 53190 

William V.* Mayer 
Human Sciences Program 
P.O. Box 930 
Boiilder, Colorado 80302 

John M. Mays 

National Institute of Education 
Washington, D.C. 20208 

Robert McCargar 

Human Behavior Curriculum Project 
Carleton College 
Northfield, Minnesota 55057 

Howard Melilinger 
Comparing Political Experiences 
Social Studies Development Center 
Indiana University 
^ Bloomington, Indiana 47401 

Anita L. Mishler 

(Man: A Course of Study)* 

8 Brookdale Road 

Newtonville, Massachusetts 02160 
Irving Morrissett 

Social Science Education Consortium 
855 Broadway 
Boulder, Colorado 80302 

Eugene D. Nichols 

Project for the Mathematical 

Development of Children 
College of Education 
The Florida State University 
Tallahassee, Florida 32306 
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Thomas C. 0*Brien 

Teachers' Center in Mathematics 

Education * - 

Department of Elementary Education 
Southern Illinois University 
Edwardsville, Illinois 62025 

Frank Oppenheimer 
Palacfe of Arts and Science 

Foundation 
3601 Lyon Street 
Sdn Francisco, California 94123 

John Patrick 

Comparing Political Experiences 
Social Studies Development Center 
Indiana University 
Bioomington, Indiana 47401 

E. J. Piel 

Technology — People — Environment 
Department of Engineering 
State University of New York 
Stony Brook, New York 11790 

Norma Reali 

Evaluation of USMES 

Educational Research Laboratory 

Boston University 

Boston, Massachusetts 02215 

James T. Robinson 
Human Sciences Program 
P.O. Box 930 
Boulder, Colorado 80302 
William D. Romey 
(Investigating the Earth)* 
Department of Geology 
St. Lawrence University 
Qanton, New York.13617 

Robert E. Samples 
Environmental Studies for 

Urban Youth 
Evergreen State College 
f)lympia, Washington 98505 

Mary H. Shann 

Evaluation of USMES 

Educational Research Laboratory 

Boston University 

Boston, Massachusetts 02215 

*Denotes completed project. 



Victor M. Showalter 
Federation for Unified Science 

Education 
P.O. Box 3138 
Columbus, Ohio 43210 

Romualdas Skvarcius 
Development of a Mathematics 

Program for Grades 7 and 8 
Physical Science Group 
Boston University 
38 Cummington Street 
Boston, Massachusetts 02215 

Lois Sokolski 

Junior High School Teachers* Center 
Department of Secondary Education 

and Matheitiatics 
University of Wisconsin 
Whitewater, Wisconsin 53190 * 
George Springer 
Problem Solving Strategies and 

Applications of Mathematics 
Department of Mathematics 
Indiana University 
Bloomington, Indiana 47401 

Leslie P. Steffe 

Georgia Center for the Study of 

Learning and Teaching Mathematics 
Department of Mathematics Education 
University of Georgia 
Athens, Georgia 306012 

Herbert U. Thier 

Outdoor Biology.Instructional 

Strategies ^ ^ 

Lawrence Hall of Science 
University of California 
Berkeley^ California 94720 

Zalma^ Usiskin 

First Year Algebra via Applications 
Graduate School of Education 
University of Chicago 
Chicago, Illinois 60637 

Hassler Whitney 

Basic Research on How Children 

Learn Mathematics 
School of Mathematics 
Institute for Advanced Study 
Princeton, New Jersey 08540 
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Lauren G. Woodby 
Department of Majthematics 
Michigan State University* 
' East Lansing, Michigan 48823 




Russell E. Zwoyer 
UICSM-Ninth Grade Course 
120 Education Building 
University of Illinois 
Urbana. Illinois 61801 
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NATIONAL SCIENCE FOUNDATION 



Education Directorate " 

Lowell J. Paige, Assistant Director for Education 

Pre-Cbllege Education in Science 
" Howard J. HausmanyDivision Director \ " ^ 

Materials and Instruction Development Section 
Laurence 0. Binder, Head Qaniel C. Yohe 

Raymond J. Hannapel James W. Wilson 

Jean B. Intermaggio Anne Keola 

Instructional Improvement Implementation Section 
Walter L. Gillespie, Head ' F. Joe Crosswhite 

Michael M. Frodyma W. "Williams Stevens, Jr. 

TheodorcL. Reid William E, Morrell 

John A. Macqini ^ Jane T. Stutsman,* 

Charles W. Wallace ' " 

AMERICAN ASSOCIATION FOR THE 
ADVANCEMENT OF SCIENCE 



Jane M. Livermore 



Orin McCarley 



CONFERENCE 
EVALUATION 



At the end of the conference, the participants completed a con- 
ference evaluation q.Uestionnaire. The majority of the participants 
responded favorably to the first statement on the 'questionnaire: 
"This conference has been useful for me." The responses were: 
2 strongly disagree 
2 disagree 
36 agFee 
18 strongly agr6e 
Responses to the second item on the questionnaire regarding 
various aspects of the conference were as follows: 

Poor Adequate Good Excellent 

Presentations and 

Reactions 2 Q 33 15 

Small Group 

Discussions 5 10 32 6 

Location and 

Facilities 0 2 17 35 

The third item on the questionnaire was the open-ended question, 
"What do you feel has been the strongest point?" The strongest 
points of the conference appeared to be: 1) that it provided an 
opportunity to exchange information among projects, and 2) that 
it provided an opportunity to interact with persons of varied 
interests and points of view. The general tone of the responses 
to this item indicate that the participants felt that this was a 
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well-planned conference that focused on issues, not on 'show 
and tell,' and that in an informal, relaxed setting it provided an 
opportunity to sharpen old ideas and develop new ones concerning 
needs in science curriculum in the schools. 

Responses to the final question, **What do you feel has been 
the weakest point?" indicated that the participants vyo^ld have 
liked to have had more time to exchange information, both in 
the organized **small groups" and in informal gatherings. 
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